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ABSTRACT 


A  critical  survey  of  technological  forecasting  techniques 
is  presented.   The  nature  of  technological  forecasting  per- 
mits the  various  techniques  to  be  classified  as  intuitive, 
exploratory,  and  normative.   Intuitive  technological  fore- 
casting is  based  on  the  informal  use  of  exploratory  and  nor- 
mative techniques,  including  the  forecaster's  biases  and 
hunches.   Exploratory  technological  forecasting  starts  from 
a  present  empirical  or  theoretical  basis  of  knowledge  and  is 
oriented  towards  the  future.   Normative  technological  fore- 
casting, on  the  other  hand,  first  assesses  future  goals  and 
missions  and  works  backward  to  the  present.   Some  pitfalls 


of  technological  forecasting  are  dl 


sential  are:   (1)  a  lack  of  imagination  on  the  part  of  the 
forecaster;  (2)  a  belief  that  the  human  intellect  can  create 
anything  it  can  conceive;  (3)  a  lack  of  consideration  of 
seemingly  unrelated  factors;  and  (4)  the  use  of  inappropri- 
ate techniques  or  incorrect  calculations.   Factors  which 
should  be  considered  in  selecting  a  forecasting  technique 
are  suggested  and  include:   (1)  the  circumstances  under  which 
the  forecaster  is  working;  (2)  the  characteristics  of  the 
data  base;  (3)  and  the  time  available  for  generating  the 
forecast. 
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I.   INTRODUCTION 

The  author  of  this  paper  has  been  interested  for  some 
time  in  the  process  by  which  the  Department  of  Defense 
acquires  new  systems.   Before  a  new  system  becomes  opera- 
tional many  decisions  are  made  concerning  alternative  tech- 
nical approaches,  alternative  force  sizes,  length  of  the 
research  and  development  phase,  and  the  like.   In  many,  if 
not  most  of  these  decisions,  the  author  believes  that  a 
particularly  important  information  input  concerns  the  state 
of  future  technology. 

In  developing  information  about  the  state  of  future 
technology,  it  becomes  necessary  to  forecast  what  will,  or 
at  least  what;  could  l~/G  available,  ba^ed  on  information  about 
the  state  of  current  technology.   Thus  the  author  was  led 
to  reviewing  the  literature  on  technological  forecasting 
in  an  effort  to  study  the  techniques  available  for  providing 
information  about  the  future  state  of  technology.   It  is 
the  purpose  of  this  paper  to  examine,  in  the  form  of  a 
critical  survey,  these  technological  forecasting  techniques 
and  in  so  doing  give  an  account  of  the  state  of  the  art  of 
technological  forecasting. 

As  indicated,  technological  forecasting,  which  has  de- 
veloped gradually  since  the  end  of  World  War  II,  attempts 
to  provide  an  indication  of  the  future  of  science  and  tech- 
nology.  The  author  of  this  paper  believes  it  has  gained 
importance  for  the  following  two  reasons.   First,  the  rapid 


growth  of  opportunity  offered  by  the  many  advances  in  science 
and  technology  necessitates  a  high  selectivity  on  the  part 
of  decision-makers  both  at  the  level  of  the  individual  firm, 
government  agency,  and  on  a  national  scale.   Choice  between 
alternative  decisions  may  make  all  the  difference  in  com- 
petitive performance.   Second,  science  and  technology  are 
recognized  as  influences  in  the  transformation  of  society 
and  as  such  governments  must  strive  to  forsee  the  impacts 
which  technological  developments  are  likely  to  have  on  future 
society  and  to  guide  the  application  of  new  knowledge  in  the 
attainment  of  national  goals . 

The  expenditure  on  both  basic  research  and  the  develop- 
ment of  its  consequences  for  practical  purposes,  whether 
peaceful  or  military,  is  growing  so  rapidly  that  it  becomes 
increasingly  important,  at  least  to  this  author,  for  govern- 
ment and  industry  to  be  clear  and  precise  on  what  they  are 
trying  to  do  and  to  study  wisely  the  best  way  of  doing  it. 
It  follows  that  it  becomes  of  great  importance  to  direct 
development  in  the  right  directions,  selecting  only  those 
alternatives  which  show  promise.   The  essence  of  the  infor- 
mation base  for  the  art  of  directing  development  is  techno- 
logical forecasting. 

Early  attempts  at  technological  prediction  were  not 
rigorous  enough  to  be  characterized  as  technological  fore- 
casting in  the  present  usage  of  these  words,  since  they  are 
largely  prophecies  resting  on  opinion  rather  than  systematic 
logic.   Although  the  history  of  predictions  gives  one  a 


feeling  for  the  progress  of  technology,  the  subject  will  not 
be  treated  in  this  paper. 

There  are  perhaps  as  many  definitions  of  technological 
forecasting  as  there  are  writers  in  the  field.   However,  a 
definition  of  technological  forecasting  suggested  by  the 
author  of  this  paper  is  as  follows:   Technological  forecast- 
ing is  the  use  of  systems  of  logical  analysis  to  induce 
probabilistic  assessments  of  future  developments  and  im- 
pacts of  technology.   Technology  in  this  sense  denotes  the 
broad  area  of  purposeful  application  of  the  contents  of  the 
physical,  life,  and  behavioral  sciences. 

Technological  forecasting  is  responsible  for  a  profu- 
sion of  literature.   This  author's  review  of  the  literature, 
however,  revealed  four  well-written  books  which  provide  a 
broad  overview  of  the  techniques,  applications  and  viewpoints 
espoused  by  most  technological  forecasting  experts  [1,2,33^]. 
These  four  books  are  recommended  as  an  excellent  starting 
point  for  those  interested  readers  wishing  to  delve  further 
into  the  subject  and  are  annotated  in  Appendix  A  of  this 
paper . 

The  reader  of  technological  forecasting  literature  is 
cautioned  to  the  fact  that  there  are  a  number  of  seemingly 
repititious  articles  as  well  as  frequent  cross-references  in 
existence.   This  point  should  not  lead  to  frustration,  since 
comparison  of  the  works  usually  reveals  subtle  differences 
in  the  author's  concept  and  philosophy  of  technological  fore- 
casting. 


A  final  word  on  the  references  used  in  this  paper  is 
appropriate.   The  List  of  References  is  confined  to  only 
those  works  cited  in  the  paper.   In  addition  to  these  ref- 
erences and  the  annotated  bibliographies  contained  in 
References  [1-4] 3    there  are  three  excellent  bibliographies 
available  to  the  reader  [6,7,8]. 

Technological  forecasting  is  not  yet  a  science,  but  an 
art,   Human  judgment  is  enhanced,  not  replaced  by  it.   If 
technological  forecasting  is  to  be  useful  in  meaningful  ap- 
plications, it  must  be  structured  and  developed  in  a  proper 
framework.   The  conceptual  framework  utilized  by  many  authors 
in  the  field  is  that  of  viewing  the  transfer  of  technology 
through  various  levels  of  development  [5] . 

By  way  of  explanation  of  this  framework,  the  concept;  of 
technology  must  first  be  treated.   The  image  of  technology, 
until  recently,  was  considered  in  terms  of  machines  and  equip- 
ment, i.e.,  hardware.   Today,  however,  technology  consists 
increasingly  of  software,  i.e.,  the  organization  and  systemi- 
zation  of  ways  of  accomplishing  tasks  [5]-   In  this  wider 
sense,  the  principles  of  management,  when  embodied  in  an  or- 
ganization or  in  a  management  system  such  as  PERT,  are  just 
as  much  technology  as  a  Polaris  missile. 

Technology  transfer,  for  hardware  or  software,  is  the 
process  by  which  science  and  technology  are  diffused  through- 
out human  activity  [5]-   This  can  be  either  transfer  from 
basic  scientific  knowledge  into  technology  (the  so-called 
vertical  transfer) ,  or  adaptation  of  an  existing  technology 
to  a  new  use  (the  so-called  horizontal  transfer). 
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Vertical  transfer  refers  to  the  transfer  of  technology 
moving  through  levels  of  development  by  which  a  "state  of 
the  art"  becomes  embodied  in  a  system  and  by  which  the  fusion 
of  several  different  technologies  leads  to  a  new  technology. 
Consider,  for  example,  the  recognition  in  solid-state  theory 
of  the  fundamental  concept  of  semi-conduction.   This  dis- 
covery in  basic  theory  eventually  led  to  integrated  circuit 
technology,  and  further  to  solid-state  communication  systems 
and  their  impacts  on  the  non-technical  environment. 

Horizontal  transfer,  on  the  other  hand,  occurs  through 
the  adaptation  of  a  technology  from  one  application  to  an- 
other.  An  example  of  this  concept  is  the  adaptation  of  a 
military  aircraft  to  civilian  air  transport.   Horizontal 
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procedures  into  medical  care  and  the  diffusion  of  military 
and  space  technologies  into  the  commercial  markets. 

Technological  forecasting  is  concerned  with  the  fore- 
casting of  technological  changes.   If  by  technological 
change  one  understands  the  development  of  the  applied 
sciences  and  their  industrial  exploitation,  then  forecasting 
will  primarily  be  concerned  with  the  capabilities  provided 
by  the  changing  state  of  the  art,  and  their  influence  on 
the  materials  and  techniques  employed  in  industrial  produc- 
tion.  However,  as  mentioned  before  in  the  discussion  of 
technology  transfer,  the  term  can  also  be  used  much  more 
broadly  to  include  the  economic  and  social  changes  which 
result  from  the  development  of  technology.   It  is  unrealis- 
tic to  discuss  any  aspect  of  technological  change  without 


considering  the  social  and  economic  environment  in  which  it 
is  expected  to  take  place.   It  is  the  complexity  of  the  in- 
teractions between  changing  technology  and  the  complex  and 
changing  environment  which  presents  technological  forecast- 
ing with  its  most  formidable  difficulties. 

The  following  three  sections  of  this  paper,  in  order 
of  their  presentation,  contain  a  detailed  discussion,  in 
eluding  description,  application  and  critique,  of  intuitive, 
exploratory,  and  normative  forecasting  techniques.   Intui- 
tive techniques  may  be  categorized  as  individual  or  consen- 
sus (committee)  forecasting.   While  a  great  deal  of  forecasting 
is  attempted  by  the  individual  technique,  the  procedures  of 
this  method  have  not  been  formulated  and  will  not  be  treated 
in  this  paper.   The  brainstorming  technique 3   where  a  £rc,,;~   of 
experts  is  gathered  freely  under  the  guidance  of  a  moderator, 
is  the  first  intuitive  technique  discussed.   Because  of  the 
inherent  difficulties  in  this  method,  the  Delphi  method  was 
designed  and  is  the  subject  of  the  remainder  of  Section  II. 

Exploratory  technological  forecasting  starts  from  a 
present  empirical  or  theoretical  basis  of  knowledge  and  is 
oriented  towards  the  future,  i.e.,  it  is  opportunity-oriented. 
Normative  technological  forecasting,  on  the  other  hand,  first 
assesses  future  goals,  needs,  and  desires  and  works  backward 
to  the  present,  i.e.,  it  is  mission-oriented.   This  differ- 
ence in  orientation  provided  the  author  with  a  logical  means 
of  categorizing  these  techniques  for  presentation  in  the 
third  and  fourth  sections. 
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The  final  section  of  this  paper  is  a  critical  ap- 
praisal of  technological  forecasting  in  general.   In  par- 
ticular, major  pitfalls,  criteria  for  selecting  a  method, 
and  the  future  of  forecasting  are  discussed. 
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II.   INTUITIVE  FORECASTING  TECHNIQUES 

A.    INTRODUCTION 

The  title  of  this  first  chapter  on  forecasting  techni- 
ques appears j  at  first  glance,  to  be  somewhat  contradictory. 
Intuition  is  -  according  to  Webster's  New  World  Dictionary  - 
"the  immediate  knowing   or  learning  of  something  without  the 
conscious  use  of  reasoning."   This  definition  of  intuition 
seems  to  deny  the  possibility  of  applying  any  technique  to 
the  intuitive  process.   However,  as  Jantsch  points  out  In 
studying  supposedly  intuitive  forecasts  of  future  technolo- 
gies, one  finds  in  general  that  they  represent  "cluttered 
pieces  of  systematic  thinking"  [1] .   In  short,  although  in- 

as  some  would  have  it  -  the  antithesis  of  rational  analysis, 
nor  should  one  imagine  that  intuition  cannot  be  improved  by 
the  application  of  system  and  order. 

Intuition  is  perhaps  the  oldest  method  of  forecasting 
[9] •   Until  recently  it  was  the  only  method,  and  now,  after 
the  development  of  other  techniques,  it  is  still  widely 
used.   Intuitive  forecasting  techniques  may  be  categorized 
for  convenience  as  individual  forecasting  or  consensus  fore- 
casting. 6 

The  simplest  of  these  two  forms  of  intuitive  forecast- 
ing is  the  individual  or  "prophet"  forecast.   If  a  certified 
"prophet"  is  available  there  is  nothing  more  to  say.   If, 
however,  either  the  "prophet"  or  "certification"  is  in  ques- 
tion the  modern  tendency  is  to  rely  on  consensus  techniques. 

12 


The  classic  example  of  the  so-called  "prophet"  is  P.  W. 
Lindemann,  Churchill's  powerful  scientific  advisor  during 
World  War  II .   He  strongly  advocated  solid-fuel  rocket 
propellants  to  the  point  that  he  refused  to  believe  that  the 
liquid-fuel  German  V-2  rocket  could  fly,  despite  photographic 
evidence  to  the  contrary  [4].   The  author's  review  of  the 
literature  did  not  reveal  any  formal  procedure  for  the  indi- 
vidual forecasting  technique  and  as  a  result  this  subject 
will  not  be  treated  in  this  section. 

This  section  will  include,  however,  a  description,  pos- 
sible applications,  and  a  critique  of  the  various  consensus 
techniques.   In  particular,  the  Delphi  technique  will  be  dis- 
cussed in  detail. 

B.    BRAINSTORMING 

The  first  consensus  technique  is  the  brainstorming 
method,  where  a  group  of  experts  is  gathered  to  speculate 
freely  under  the  guidance  of  a  moderator.   The  brainstorming 
technique  is  designed  deliberately  to  create  an  environment 
conducive  to  speculation.   The  reason  for  this  radical  be- 
havior is  simply  to  alleviate  the  conservative  nature  of 
conventional  type  committees.   Ayres  cites  the  1937  study  of 
the  National  Research  Council  as  an  example  of  the  effects 
of  conservative  forecasting  [4].   The  Council  virtually 
missed  all  of  the  major  developments  of  the  decade,  includ- 
ing antibiotics,  radar,  jet  engines,  and  atomic  energy. 

Jantsch  [1]  offers  the  following  basic  rules  for  brain- 
storming sessions: 
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1.  State  the  problem  in  basic  terms,  with  only  one 
focal  point . 

2.  Do  not  find  fault  with,  or  stop  to  explore,  any 
idea . 

3.  Reach  for  any  kind  of  idea,  even  if  its  relevance 
may  seem  remote  at  the  time. 

4.  Provide  the  support  and  encouragement  necessary  to 
liberate  participants  from  inhibiting  attitudes. 

The  moderator  or  group  leader  is  responsible  for  re- 
minding the  participants  of  the  above  mentioned  rules  and 
encouraging  uninhibited  discussion.   He  also  directs  the 
interaction  in  such  a  way  that  the  various  opinions  produced 
form  a  consensus . 

A  survey  of  the  literature  suggests  tliat  little  has 
been  published  concerning  the  applications  and  effectiveness 
of  this  technique.   One  reason  for  this  apparent  lack  of 
interest  is  the  possible  domination  of  the  discussion  by  one 
person.   A  quite  convincing  series  of  studies  have  shown 
that  the  group  opinion  as  used  in  the  brainstorming  scheme, 
is  likely  to  be  highly  influenced,  if  not  determined,  by 
the  views  of  the  member  of  the  group  who  does  the  most  talk- 
ing [10].   Another  difficulty  is  the  introduction  of  noise 
in  the  discussion.   Noise  is  simply  irrelevant  or  redundant 
material  offered  by  the  participants.   A  third  difficulty  is 
that  group  pressure  has  a  tendency  to  overvalue  reaching  a 
consensus,  i.e.,  the  "bandwagon"  effect  of  majority  opinion. 

The  Delphi  technique  is  designed  to  overcome  these  dif- 
ficulties and  is  the  subject  of  the  following  paragraphs. 
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C.    DELPHI 

Helmer  and  Dalkey  of  the  Rand  Corporation  invented  the 
Delphi  method  in  the  hope  of  rectifying  the  aforementioned 
difficulties  of  the  brainstorming  techniques  [11].   In  its 
simplest  form,  it  eliminates  committee  activity  among  the 
experts  altogether  and  replaces  it  with  a  carefully  designed 
program  of  sequential,  individual  interrogations  [2]. 

The  Delphi  procedure  consists  of  three  distinctive 
characteristics:   anonymity,  controlled  feedback,  and  sta- 
tistical group  response  [11] .   Anonymity  is  a  device  to  re- 
duce the  effect  of  the  dominant  individual.   It  is  maintained 
by  eliciting  separate  and  private  answers  to  prepared  ques- 
tions.  Ordinarily,  the  procedure  is  carried  out  by  written 
questionnaire  or  other  formal  communication   channels ,  such 
as  on-line  computers.   All  other  interactions  between  respon- 
dents is  through  formal  communication  channels  controlled  by 
the  director  of  the  forecast. 

Controlled  feedback  is  a  device  to  reduce  noise.   This 
is  accomplished  by  conducting  the  exercise  in  a  sequence  of 
rounds  between  which  a  summary  of  the  results  of  the  previous 
round  are  communicated  to  the  participants. 

The  statistical  group  response  is  a  device  to  assure 
that  the  opinions  of  every  member  of  the  group  is  represented 
in  the  final  response.   For  cases  where  the  group  task  is  to 
estimate  a  numerical  quantity,  the  median  of  individual  es- 
timates is  the  most  useful  index  tried  to  date  [11].   Thus, 
there  is  no  particular  attempt  to  arrive  at  unanimity  among 
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the  respondents,  and  a  spread  of  opinions  on  the  final  round 
is  the  normal  outcome.   This  is  a  further  device  to  reduce 
group  pressure  toward  conformity. 

A  typical  exercise  is  initiated  by  a  questionnaire 
which  requests  estimates  of  a  set  of  numerical  quantities, 
e.g.,  dates  at  which  technological  possibilities  will  be 
realized,  probabilities  of  realization  by  given  dates,  or 
levels  of  performance.   The  results  of  the  first  round  are 
summarized  using  the  median  and  the  interquartile  range  of 
the  responses.   The  interquartile  range  is  the  interval  con- 
taining the  middle  50 %  of  the  responses .   The  results  are 
then  fed  back  to  the  participants  with  a  request  to  revise 
the  first  estimates  where  appropriate.   On  succeeding  rounds, 

-r-  V-i  ^>  *-i  -    ----^-?TT-?^^Tiotr«   *  .t  t~i  r\  f-<  /~\        *3  v-»  r-i  i ,  t  *— j  -y^  (-i    rt^i'T-i  «-*•{(->   in  m  nc  n"  '  \  '    '  fw  W'   i    rw_> 

median,  e.g.,  outside  the  interquartile  range,  are  requested 
to  justify  their  estimates.   These  justifications  are  sum- 
marized, fed  back,  and  counterarguments  elicited.   The  coun- 
terarguments are  in  turn  fed  back  and  additional  reappraisals 
collected . 

The  principles  involved  in  this  procedure  can  further  be 
described  by  referring  to  a  hypothetical  example.   Consider 
an  inquiry  into  the  future  of  automobiles  in  which  each  mem- 
ber  of  a  panel  of  experts  is  asked  to  estimate  the  year  (if 
ever)  that  they  expect  electric  cars  to  capture  ten  percent 
of  the  automobile  market . 

The  initial  responses  might  consist  of  a  set  of  estimates 
spread  over  a  sizeable  time-interval,  i.e.,  from  1973  to  1998 
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with  a  median  of  1990.   A  follow-up  questionnaire  feeds  back 
to  the  respondents  a  summary  of  the  distribution  of  these 
responses,  stating  the  median  and  -  as  an  indication  of  the 
spread  of  opinions  -  the  interquartile  range.   The  respon- 
dents are  then  asked  to  reconsider  their  previous  answers 
and  revise  them  if  they  so  desire.   If  a  new  response  lies 
outside  the  interquartile  range,  the  particular   respondent 
is  asked  to  state  his  reason  for  thinking  that  the  answer 
should  be  that  much  lower,  or  that  much  higher,  than  the 
majority  judgment  of  the  group. 

Placing  the  onus  of  justifying  relatively  extreme  re- 
sponses on  the  respondents  has  the  effect  of  causing  those 
without  strong  convictions  to  move  their  estimates  closer 
to  the  znedlaii3  while  those  who  feel  they  have  a  good  argu- 
ment for  a  "deviant"  opinion  tend  to  retain  their  original 
estimates  and  defend  them. 

In  the  next  round,  responses  (now  usually  spread  over 
a  smaller  interval)  are  again  summarized  and  the  respondents 
are  given  a  concise  summary  of  the  reasons  presented  in  sup- 
port of  extreme  positions .   They  are  then  asked  to  revise 
their  second-round   responses,  taking  the  preferred  reasons 
into  consideration  and  giving  them  whatever  weight  they 
think  is  justified.   A  respondent  whose  answer  still  remains 
outside  the  interquartile  range  is  required  to  state  why  he 
is  unpersuaded  by  the  opposing  arguments.   In  a  fourth  and 
final  round,  these  criticisms  of  the  reasons  previously  of- 
fered are  resubmitted  to  the  respondents,  and  they  are  given 


17 


a  last  chance  to  revise  their  estimates.   The  median  of  these 
final  responses  is  then  taken  as  representing  the  nearest 
thing  to  a  group  consensus.   In  the  hypothetical  case  of  the 
electric  cars,  this  median  might  turn  out  to  be  the  year 
1985,  with  a  final  interquartile  range  from  1980  to  1990. 
The  procedure  therefore  causes  the  median  to  move  to  a  much 
earlier  date  and  the  interquartile  range  to  shrink  consid- 
erably, presumably  influenced  by  convincing  arguments. 
Bright ' s  text  contains  an  excellent  example  of  an  actual  ap- 
plication of  the  Delphi  method  [2] . 

The  hypothetical  example  presented  above  is  intended  to 
describe  the  basic  procedures  of  the  Delphi  technique.   A 
series  of  experiments  were  initiated  at  Rand  to  evaluate 
these  procedures  and  to  explore  Lhe  nature  of  the  informa- 
tion processes  occurring  in  the  Delphi  interaction  [11,12]. 
The  two  basic  issues  examined  were  a  comparison  of  face-to- 
face  discussion  (Brainstorming)  with  the  controlled  feedback 
interaction  (Delphi),  and  a  thorough  evaluation  of  controlled 
feedback  as  a  technique  for  improving  group  estimates .   The 
results  of  the  study  indicated  that  face-to-face  discussion 
tends  to  make  the  group  estimate  less  accurate,  whereas,  the 
anonymous  controlled  feedback  procedure  made  the  group  esti- 
mates more  accurate.   "Accuracy"  in  this  context  refers  to 
the  distance  of  the  median  to  the  true  answer.   According  to 
Dalkey,  the  experiment  put  the  application  of  Delphi  techni- 
ques in  areas  of  partial  information  on  much  firmer  ground 
[11]. 
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Of  greater  long-range  significance  is  the  insight 
gained  into  the  nature  of  the  group  information  process. 
For  example,  Delphi  procedures  create  a  well-defined  pro- 
cess that  can  be  described  quantitatively.   In  particular, 
the  study  found  that  the  average  error  on  round  one  is  a 
function  of  the  dispersion  of  the  answers  and  the  average 
amount  of  change  of  opinion  between  round  one  and  round 
two  is  a  well-behaved  function  of  two  parameters  -  the  dis- 
tance of  the  first-round  answer  from  the  group  median,  and 
the  distance  from  the  true  answer. 

Another  result  of  major  significance  is  that  a  meaning- 
ful estimate  of  the  accuracy  of  a  group  response  to  a  given 
question  can  be  obtained  by  combining  individual  self-rat- 
ings of  competence  on  that  question  into  a  group  rating. 
This  result,  when  combined  with  the  relationship  between 
accuracy  and  the  median  mentioned  above  opens  the  possibility 
of  attaching  accuracy  scores  to  the  products  of  a  Delphi  ex- 
ercise [11]  . 

The  Delphi  technique  has  been  criticized  in  the  past 
because  it  yields  a  set  of  "linearly  independent"  estimates 
of  the  future,  i.e.,  the  experts  consider  each  event  inde- 
pendently and  omit  consideration  of  the  interaction  among 
events.   The  experts  unconsciously  consider  relationships 
among  events,  but  they  do  not  view  the  future  as  a  set  of 
interrelated  paths.   In  an  effort  to  improve  this  situation 
a  "cross  correlation"  scheme  is  presently  under  investiga- 
tion and  has  been  employed  by  Gordon  in  a  forecasting  game 
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designed  for  Kaiser  Aluminum  and  Chemical  Corporation  [2] . 
To  describe  this  new  approach  consider  that  a  list  of  de- 
velopments are  forecast,  with  varying  levels  of  probability, 
to  occur  prior  to  a  given  year.   If  these  developments  are 

designated  D-,  ,  D„,  .  .  . , -D  ,  with  associated  probabilities 
o        1 J   2        n ' 

P_  ,  P_,....P  ,  then  the  question  can  be  posed:   "If  P.-+1.00, 

i.e.,  D.  occurs,  how  do  Pn ,  P„,...,P   change"?   If  there  is 
'   i        3  1 '   2       n      ° 

a  "cross  correlation",  the  probability  of  individual  items 
will  vary  accordingly.   In  order  to  construct  the  game  de- 
scribed above,  a  60  x  60  matrix  is  reviewed  for  item  cross 
correlations .  If  one  considers  a  forecast  with  a  thousand 
possible  developments  and  that  initial  probabilities  for 
each  of  these  are  established  for  a  given  year,  it  is  plau- 
sible lhat  the  utit;  jf  ^OKip^Lcrs  v:oulcl  greatly  enhance  the 
reviewing  of  such  an  extensive  matrix. 

The  use  of  computers  has  also  been  instrumental  in 
eliminating  another  shortcoming  of  the  Delphi  technique. 
For  example,  at  the  Rand  Corporation  the  JOSS  computer  is 
used  to  control  a  series  of  simple  Delphi  studies  [2].   JOSS 
is  a  centralized,  general  purpose  computer  which  is  pro- 
grammed to  accept  English  language  instruction  and  has  tele- 
typewriter input/output  stations  at  several  remote  locations 
in  the  Rand  building.   Gordon  claims  it  is  presently  feasible 
to  include  participants  located  almost  anywhere  in  the  world 
in  such  computer  controlled  interactions. 

The  Delphi  technique  has  proven  extremely  useful  for 
long-range  forecasting  of  expected  technological  and  socio- 
logical developments  such  as  political  alliances,  technological 
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potentials,  war  prevention  techniques,  and  economic  indices 
[2].   Results,  as  noted  in  Reference  2  for  a  limited  number 
of  cases,  indicates  consensus  seems  to  have  been  achieved, 
the  forecast  was  verified,  and  the  potential  developments 
which  were  described  provided  a  basis  for  subsequent  plan- 
ning action.   However,  the  reader  is  cautioned  that  in 
evaluating  such  forecasts  one  should  remember  at  all  times 
that  they  are  intuitive.   The  evaluation  must  be  made  with 
respect  to  the  forecast's  authors,  including  the  director  or 
moderator.   The  moderator  has  great  influence  over  the  re- 
sults of  the  forecast  in  that  he  chooses  the  experts,  makes 
the  initial  decision  of  what  events  to  include,  and  is  also 
responsible  for  all  the  feedback  to  the  experts. 

The  author  of  this  paper  note?  that  although  there  ~^p 
many  strengths  and  weaknesses  of  the  Delphi  method,  its  most 
valuable  contribution  to  forecasting  is  its  interaction  with 
exploratroy  and  normative  techniques.   These  techniques, 
built  around  the  basic  Delphi  concept,  provide  a  new  set  of 
approaches  for  the  forecaster  and  a  new  flexibility  for  ap- 
proaching problems  which  are  not  accessible  to  more  direct 
methods  of  analysis .   Taken  together  they  indicate  that  the 
methodology  of  forecasting  is  only  now  being  formulated  and 
that  in  the  near  future  these  analytic  methods  will  be 
sharpened,  tested,  and  objectively  used. 
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III.   EXPLORATORY  FORECASTING  TECHNIQUES 

A.    INTRODUCTION 

Exploratory  technological  forecasting  starts  from  a  pre- 
sent empirical  or  theoretical  basis  of  knowledge  and  is  ori- 
ented toward  the  opportunities  of  the  future.   This  technique 
looks  on  the  future  in  a  general  manner  and  follows  the  prog- 
ress of  a  particular  technology  or  all  of  technology  as  a 
function  of  time.   In  other  words,  exploratory  forecasting 
is  analogous  to  writing  history  in  advance. 

Exploratory  techniques  can  be  divided  into  two  classes. 
The  first  class  consists  of  the  techniques  which  generate 
new  technological   information.   These  comprise  two  groups. 
rj-pfat  ils  ex i/Papoj.a i/ion  01  uirne  serien  t.cinri  'yen  c  anct  pnoncme— 
nological  and  second  is  morphological  analysis.   The  second 
class  consists  of  techniques  which  structure  and  process 
given  technological  information.   These  include  scenario 
writing,  uncertainty  techniques,  cost/benefit  analysis, op- 
erational models  and  input/output  analysis. 

The  distinction  between  the  two  classes  is  important 
and  therefore  warrants  further  discussion.   Since  any  complete 
technological  forecasting  process  has  to  include  techniques 
for  generating  some  of  the  essential  characteristics  of  fu- 
ture technologies,  this  aspect  constitutes  the  oldest  concern 
of  technological  forecasting.   Jantsch  points  out  that  al- 
though it  is  the  oldest,  this  class  of  exploratory  forecasting 
is  not  at  all  satisfactory,  and  may  even  be  said  to  be  under- 
developed in  relation  to  other  fore  casting  aspects  [1] . 
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The  other  class  of  exploratory  techniques,  those  struc- 
turing and  processing  given  technological  information,  are 
relatively  abundant.   Jantsch  predicts  their  importance  will 
increase  with  the  use  of  large-scale  forecasting  to  evaluate 
large  amounts  of  input  data  and  programmed  relationships  [1] . 
He  believes  that  this  class  of  explorating  forecasting  will 
attain  full  importance  only  when  technological  forecasting  is 
included  in  future  systems  of  information  technology. 

This  chapter  includes  a  description  of  each  of  the  pre- 
viously mentioned  techniques.  The  advantages,  disadvantages 
and  applications  of  each  technique  will  also  be  included. 

B.    EXTRAPOLATION  OF  TIME  SERIES 
1.   AnaJLyti_c  Models 

Many  quantitative  characteristics  exhibit  an  ex- 
ponential or  nearly  exponential  growth  over  time,  with  a 
subsequent  flattening  when  a  limit  or  saturation  value  is 
approached.   For  example,  consider  trends  of  specific  tech- 
niques which  enable  a  functional  capability  to  be  achieved. 
Initially  the  technique  tends  to  experience  a  period  of  slow 
growth,  it  might  be  hidden  in  a  laboratory  at  this  time  or 
buried  in  the  patent  office.   Finally,  its  potential  is 
recognized,  money  and  labor  are  poured  in,  problems  are 
solved,  and  an  accelerated  growth   occurs.   Eventually, 
limiting  factors  are  encountered,  the  growth  rate  deceler- 
ates, and  the  curve  asymptotically  approaches  some  upper 
value.   Explicit  examples  of  this  phenomena  are  presented 
in  chronological  order  in  the  following  paragraphs. 
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The  extrapolation  of  time  series  constitutes  per- 
haps the  principal  quantitative  technique  which  is  available 
to  technological  forecasting.   The  slope  of  the  curve  is 
usually  forecast  on  the  basis  of  a  subjective  belief,  at 
least  over  short  or  medium  time  range,  that  the  growth  law 
of  the  past  will  also  determine  the  future  growth.   Fre- 
quently this  belief  that  past  is  prologue  is  called  naive 
forecasting.   The  simple  models  presented  in  this  section 
are  intended  to  link  the  shape  of  technological  growth  curves 
to  such  factors  as  time  in  the  hope  that  the  generalization 
derived  will  yield  a  useful  tool  for  quantitative  trend  ex- 
trapolation . 

According  to  Lenz,  attempts  to  develop  a  theory  ex- 
plaining why  technical  progress  should  proceed  In  a::  exponen- 
tial manner  date  back  to  the  theory  advanced  by  Henry  Adams 
[13].   Adams  compared  the  acceleration  of  progress  with  the 
effect  of  a  new  mass  which  is  introduced  into  a  system  of 
forces  (previously  in  equilibrium)  to  accelerate  the  system's 
motion  until  a  new  equilibrium  is  established.   The  accumu- 
lated information  is  analogous  to  the  distance  traveled  by 
the  new  mass;  the  rate  of  information  gain  is  analogous  to 
the  speed;  and  the  second  derivative  of  information  over 
time  is  analogous  to  an  acceleration  which  is  assumed  con- 
stant.  Adams  further  remarks  that  science  is  doubling  its 
complexities  every  ten  years,  which  is  equivalent  to  an  ex- 
ponential model  of  technological  progress. 

Hartman  derives  his  model  from  a  simple  analogy 
with  reaction  processes  in  a  gas  [1] .   In  Hartman's  "gas", 
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the  molecules  are  scientists  and  pieces  of  information,  both 
occurring  at  a  given  volume  density  (N  scientists  per  cubic 
foot).   The  "scientist  molecules"  do  not  move  significantly, 
whereas  the  "information  molecules"  move  with  assumed  constant 
velocity  in  random  directions.   A  useful  reaction,  i.e.,  the 
generation  of  new  information,  is  supposed  to  occur  when  the 
scientist  molecules  have  a  "reaction  cross  section"  on  being 
hit  by  the  information  molecules.   The  "reaction  cross  sec- 
tion" is  simply  the  target  area  of  scientists  for  the  genera- 
tion of  new  information  through  collision  between  the  two 
types  of  "molecules." 

The  information  gain  in  this  model  depends  on  the 
amount  of  information  already  available  and  this  fact  closely 
parallels  the  general  thinking  on  the  production  of  scientific 
and  technological  results.   The  author  of  this  model  assumes 
ideal  communication  between  all  investigators  and  all  sources 
of  information.   He  further  assumes  that  every  opportunity 
presented  by  this  communication  can  in  fact  be  exploited. 
Both  of  these  assumptions  certainly  do  not  hold  for  the 
overall  growth  of  science  and  technology  where  communication 
is  not  ideal  and  where  far  more  opportunities  for  the  produc- 
tion of  new  information  exist  than  can  be  followed  up.   Con- 
sider,  for  example,  the  simultaneous  discovery  of  a  new 
theorem  by  two  mathematicians  working  independently  of  each 
other.   However,  Hartman's  model  may  be  a  useful  approach  to 
research  and  development  in  a  specific  field  or  within  a 
small  research  team. 
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In  addition,  it  is  this  author's  opinion  that  this 
model  also  has  the  advantage  of  flexibility  with  respect  to 
possible  refinements.   For  example,  the  use  of  statistical 
distributions  for  the  factors  taken  as  constant  in  the  sim- 
ple model. 

In  another  model,  Lenz  proposes  the  use  of  Pearl's 
formula  to  describe  biological  population  growth  as  a  func- 
tion of  time  in  a  limited  environment  [13] •   The  biological 
processes  investigated  by  Pearl  were  the  rate  of  increase  of 
fruit  flies  within  a  bottle,  the  rate  of  increase  of  yeast 

* 

cells  in  a  given  environment,  and  the  rate  of  cell  increase 
in  white  rats . 

Each  of  Pearl's  examples  follows  the  same  simple 
mat hema'D i c 3.1.   -Law,  namely j 

P 
P  = 


1  +  a  exp(-at) 

where  P  is  the  population  or  cell  mass  at  time  t,  P   was  the 
population  at  the  beginning  of  the  experiment,  and  A  and  a 
are  constants.   If  this  law  is  applied  to  the  generation  of 
new  information  the  following  interesting  analogy  results: 


1  +  B  exp(-bt) 

where  I  is  the  accumulated  information  (state  of  knowledge) 
at  time  t,  L  is  the  upper  limit  of  information  due  to  some 
constraint,  e.g.,  an  individual's  Intelligence  Quotient  (IQ), 
and  B  and  b  are  again  constants.   The  constant  B  fixes  the 
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position  of  the  curve  in  the  time  dimension,  i.e.,  a  dif- 
ference in  B  means  shifting  the  curve  to  the  right  or  to  the 
left.   The  constant  b  fixes  the  slope  of  the  curve. 

One  of  the  advantages  of  this  biological  analogy  is 
explained  by  the  fact  that  it  yields  a  symmetrical  S-shaped 
curve  without  any  further  assumptions  concerning  the  given 
constraints.   Thus,  with  the  knowledge  of  an  ultimate  limit, 
the  complete  curve  can  be  extrapolated  on  the  basis  of  a  very 
short  time-series.   The  critical  point  of  this  analogy  is, 
of  course,  to  know  which  scientific,  technical,  and  func- 
tional parameters,  if  any,  can  be  expected  to  follow  this 
simple  law  precisely.   Prehoda  comments  that  S-shaped  curves 
apply  to  such  diverse  situations  as  the  market  sales  of  a 
new  innovation,  military  build-up  in  the  force  of  an  external 
threat  and  tax  trends  [Ik] . 

Another  interesting  aspect  of  the  biological  analogy 
is  that  it  identifies  natural  stages  of  development,  which 
succeed  each  other  in  an  orderly  fashion.   That  is,  from 
gestation  to  maturity  there  are  many  intervening  processes 
which  cannot  be  eliminated  -  nor  can  they  be  accomplished  in- 
stantly -  regardless  of  motivations  or  incentives.   The  life- 
cycle  analogy,  therefore,  seems  to  have  a  considerable  degree 
of  utility  as  regards  the  ordering  or  structuring  of  events. 

However,  the  analyst  must  recognize  this  analogy 
carries  with  it  the  erroneous  implication  that  each  technology 
has  a  "life"  of  its  own,  and  that  its  evolution  is  governed 
by  some  internal  dynamic  law  with  stages  of  fixed  length.   In 
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fact  the  transition  from  one  stage  to  another  may  in  some 
cases  be  so  rapid  as  to  be  almost  unnoticed.   It  may  happen 
that  a  technology  approaches  maturity  for  a  specialized  mar- 
ket much  faster  than  it  does  in  other  markets.   Moreover, 
change  need  not  always  result  in  progress  in  the  forward 
direction.   Instances  of  regression  have  occurred  where  a 
technology  reverts  to  an  earlier  state  as  a  result  of  de- 
velopments in  other  fields.   For  example,  Ayres  cites  the 
example  of  early  nineteenth  century  robots  which  were  al- 
lowed to  lapse,  only  to  be  revived   again  in  the  twentieth 
century  [4] . 

An  examination  of  the  models  outlined  In  this  sec- 
tion leads  to  the  conclusion  that  no  model  has  so  far  suc- 
ceeded in  taking  into  account  more  than  a  iirrirrn  number  of 
influencing  factors  by  assuming  relationships  that  are  gen- 
erally improved  or  not  known  in  detail.   No  explanation  has 
yet  been  given  of  why  growth  trends  in  technical  parameters 
or  functional  capabilities  should  be  directly  proportional 
to  the  growth  of  accumulated  knowledge.   They  may  in  fact 
be  proportional  to  the  logarithm  of  the  accumulated  know- 
ledge.  The  principal  usefulness  of  such  simple  analytical 
models  may  be  seen  to  lie  in  their  making  visible  the  in- 
fluence  of  external  factors  which  are  responsible  for  the 
relationship  between  technical  progress  and  time. 
2 .   Phenomenological  Models 

An  obvious  method  of  technological  forecasting  is 
to  assume  that  whatever  has  happened  in  the  past  will  continue 
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to  happen  in  the  future,  provided,  of  course,  there  are  no 
major  disturbances.   It  is  natural  to  let  experience  be  a 
guide  for  future  expectations  and  the  more  inferences  are 
tested  based  on  this  past  experience  and  found  to  "fit  the 
observations,"  the  most  subjective  confidence  can  be  ob- 
tained.  This  increased  confidence  can,  moreover,  be  expres- 
sed numerically  regardless  of  whether  or  not  there  is  any 
generally  accepted  theory  to  explain  the  observed  relation- 
ship.  For  example,  if  it  is  known  that  the  crime  rate  has  a 
high  correlation  with  the  phases  of  the  moon,  this  informa- 
tion could  provide  valuable  information  to  those  who  are 
responsible  for  the  scheduling  of  policemen.   Before  a 
numerical  expression  can  be  derived  certain  basic  charac- 
teristics need  to  be  established.   First  s    the  tr^ncl  under 
study  should  be  capable  of  being  quantified  as  a  ratio 
scale.   Second,  the  trend,  i.e.,  the  relationship,  should 
have  a  significant  effect  in  the  area  being  forecast.   Third, 
a  data  base  should  exist  on  which  to  establish  a  trend  line. 

Several  types  of  trend  curves  which  describe  a  re- 
lationship between  a  parameter  and  time  have  been  presented 
by  Jantsch  [1] .   He  divides  trend  curves  into  five  classes 
which  are  illustrated  by  the  accompanying  sketches  and  ex- 
amples . 

The  first  class,  linear  increase  with  flattening,  is 
shown  in  Figure  1.   The  efficiency  of  thermal  power  plants 
exhibits  these  characteristics  and  the  mechanization  of  human 
work  expressed  in  terms  of  the  decrease  in  annual  working 
hours  per  man   has  also  been  linear  over  the  past  75  years. 
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The  second  class,  exponential  increase  with  no  flat- 
tening in  the  considered  time  range,  is  shown  in  Figure  2. 
These  characteristics  are  exhibited  by  a  number  of  functional 
capabilities.   For  example,  the  maximum  combat  aircraft  speed 
or  the  maximum  transport  aircraft  speed  up  to  the  planned  op- 
erational availability  of  the  SST.   The  almost  precisely  ex- 
ponential increase  of  energy  conversion  efficiency  (lumens 
per  watt)  in  illumination  technology  from  the  paraffin  can-  k 
die  to  the  gallium  arsenide  diode  seems  to  suggest  that  a 
functional  capability  can  follow  a  class  2  trend  until  it 
abruptly  hits  a  limit  -  the  gallium  arsenide  diode's  effi- 
ciency is  already  close  to  one. 
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The  third  class,  the  S-shaped  curve,  is  shown  in 
Figure  3-   Apart  from  the  logistic  curves  discussed  previous- 
ly, one  may  also  find  S-shaped  growth  curves  which  can  repre- 
sent Gompertz ' law .   This  law  describes  growth  phenomena  in 
some  areas  of  economics,  such  as  income  growth.   In  contrast 
to  Pearl's  law^ Gompertz '  law  represents  a  non-symmetrical  S- 
curve . 

The  fourth  class,  double  exponential  or  steeper  in- 
crease, with  subsequent  flattening,  is  shown  in  Figure  k. 
These  characteristics  hold  for  some  functional  capabilities 
in  areas  of  concentrated  research  and  development.   Two  ex- 
amples are  maximum  speed  attained  by  man  and  operating  energy 
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Figure  4.   Double  Exponential  Or  Steeper  Increase  with  Sub- 
Sequent  Flattening. 
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in  particle  accelerators.    It  is  interesting  to  note  that 
operating  speed  of  commercial  computers  would  also  belong  to 
this  class . 

The  fifth  class ,  slow  exponential  increase  followed 
by  sudden  and  rapid  increase  with  eventual  flattening,  is 
shown  in  Figure  5-   This  type  of  curve  applies  to  the  maxi- 
mum explosive  power  available  for  delivery  at  a  distance. 
The  very  steep  rise  is,  of  course,  mainly  due  to  the  advent 
of  nuclear  fission  and  fusion  weapons .   The  flattening  of 
the  curve  is  caused  by  the  effective  limit  of  utility  at  ap- 
proximately 100  megatons  rather  than  by  technical  limitations 
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Figure  5-   Slow  Exponential  Increase  Followed  by  Sudden  and 
Rapid  Increase  with  Eventual  Flattening. 
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Trend  evaluation  and  extrapolation  on  a  simple 
phenomenological  basis  has  become  a  widely  used  technique. 
It  provides  a  first  answer  to  the  question  of  whether  a 
specific  goal  has  a  reasonable  chance  of  being  attained  by 
the  same  mechanism  which  produced  past  progress.   Two  re- 
finements of  trend  extrapolation  can  be  applied  with  con- 
siderable advantage  in  suitable  cases:   forecasting  by 
analysis  of  precursive  events,  and  forecasting  by  envelope 
curve  extrapolation.   They  will  be  discussed  in  the  follow- 
ing paragraphs . 

Forecasting  by  analysis  of  precursive  events  uses 
the  correlation  of  progress  trends  between  two  developments, 
one  of  which  is  leading  the  other.   Lenz  has  stated  that  if 
the  Lime  lag  is  sufficiently  long3  a  useful  long-range  fore- 
cast is  possible  [13] •   He  gives  an  interesting  and  plausible 
example,  as  shown  in  Figure  6,  of  a  sequential  relationship 
in  the  correlation  of  the  maximum  speed  of  military  aircraft 
to  the  maximum  speed  of  commercial  aircraft. 

The  two  developments  are  logically  related  to  each 
other  in  the  way  depicted.   That  is,  the  research  and  devel- 
opment effort  applied  to  combat  aircraft  eventually  bears 
fruit  in  the  transport  sector.   It  should  be  noted,  however, 
that  such  a  simple  correlation  is  valuable  for  forecasting 
only  insofar  as  the  leader-follower  relationship  is  main- 
tained.  This  relationship  has  undergone  several  changes  in 
the  example  cited  above.   Civilian  transport  development, 
for  the  first  time,  has  recently  received  substantial  support 
from  the  government.   With  the  cancellation  of  the  SST  program 
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and  the  recent  problems  in  military  cost  overruns,  the  trend 
curves  and  the  correlation  between  them  is  a  matter  of  great 
speculation . 

Ayres,  who  has  treated  envelope  techniques  in  the 
greatest  depth,  states  that  envelope  curves  are  hypothetical 
curves  that  describe  the  maximum  performance  available  for 
any  particular  functional  characteristic,  regardless  of  the 
configuration  of  the  device  which  is  employed  [4],   The  defi- 
nition of  an  envelope  curve  is  best  presented  by  means  of 
an  illustration.   Figure  7  is  a  plot  of  the  maximum  energy 
available  from  high-energy  particle  accelerators  (atom 
smashers)  [2].   Typically,  each  new  type  of  machine  takes 
the  lead  for  a  short  period  of  time  and  then,  because  of  in- 
herent limitations 3  11  reaches  the  end  of  its  phase  of  rapid 
improvement  while  a  newer  invention  escalates  to  a"  higher  lev- 
el.  The  "envelope"  is  a  curve  which  approximates  the  general 
trend  and  is  tangent  to  the  individual  performance  trends . 

Envelope  curves  can  be  used  to  enclose  the  indivi- 
dual S-shapred  curves  and  then  to  extrapolate  a  projected 
range  of  the  capability  rather  than  a  single-valued  projec- 
tion.  Livingston  has  stated  that  envelope  curves  can  yield 
more  reliable  forecasts  than  those  approaches  based  mainly 
upon  consideration  of  the  projected  capabilities  of  specific 
techniques  [2].   The  logic  involved  here  is  that  if  the  fore- 
caster, say  in  1950,  looked  closely  at  the  capabilities  of 
known  techniques  for  particle   accelerators,  there  limits  or 
barriers  would  be  fairly  visible.   On  the  other  hand,  the 
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future  innovations  or  break  throughs  would  be  more  difficulty 
if  not  impossible  to  see.   The  result  would,  most  likely,  be 
an  overly  conservative  forecast  showing  an  incorrect  leveling 
off.   In  envelope  extrapolation  the  burden  of  proof  is 
shifted  and  the  forecaster  assumes  that  progress  will  contin- 
ue within  the  envelope  range  unless  a  definite  limit  or  per- 
turbation can  be  identified.   He  asks  what  might  cause  the 
continuation  of  invention,  not  what  detailed  hardware  or  tech- 
nique will  be  required  (engineering  development) .   The  tech- 
nique of  envelope-curve  extrapolation  presents  an  interesting 
proposition  which  can  cause  forecasters  to  change  their  ap- 
proach to  the  analysis  of  a  forecast  area.   It  leads  to  a 
broader  viewpoint  that  forces  an  analysis  of  limits  and  at 
the  same  time  promotes  an  analysis  of  causal  factors  acting 
upon  the  system. 

The  final  technique  to  be  discussed  in  this  section 
is  mathematical  trend-fitting.   These  techniques  have  been 
developed  with  the  use  of  well  known  statistical  techniques 
and  are  widely  employed  in  economic  forecasting.  ;  Trend  fit- 
ting can  be  simplified  by  determining  first  to  which  class 
a  given  trend  belongs:   linear  increase;  exponential  increase 
or  S-curve.   If  the  empirical  data  to  be  used  in  making  the 
projections  are  from  a  reliable  source,  the  appropriate  equa- 
tions from  the  first  step  may  be  used  in  conjunction  with  the 
method  of  least  squares  to  project  future  values  of  significant 
parameters . 

The  method  of  least  squares  fits  a  straight  line, 
parabola,  or  higher  degree  polynomial  to  a  given  set  of  data. 
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It  specifies  that  the  best  fit  for  a  polynomial  of  a  given 
degree  results  when  R,  the  sum  of  the  squares  of  the  residuals, 
is  a  minimum.   It  is  assumed  that  the  values  of  the  indepen- 
dent variable  X.,  are  error  free.   The  residuals  are  defined 
as  the  distances  between  observed  values  of  the  dependent 
variable  Y.,  and  the  corresponding  y  values  of  the  curve 
being  fitted,  measured  parallel  to  the  y-axis . 

To  determine  the  parameters  (constants)  of  the  de- 
sired polynomial  a  set  of  normal  equations  is  derived  by  a 
squaring  and  minimizing  process.   For  example,  if  f(x)  is 
a  straight  line,  y  =  a  +  bx.   The  ordinates  of  the  straight 
line  being  fitted  are  a  +  bx.   The  summation  becomes: 

n 
r=\    rv   _  ^  +  hY  U2 

i  =  l 

where  n  is  equal  to  the  number  of  data  points. 

The  most  common  method  of  trend  prediction  makes  use 
of  regression  analysis.   If  two  parameters  X  and  Y  are  to  be 
related  to  each  other,  one  postulates  a  relationship  between 
them,  for  example  y  =  a+bx,  and  minimizes  the  total  error 
for  a  number  n  of  observed  pairs  (X.,Y.)  by  the  least  squares 
method . 

By  setting  the  first  derivative  of  R  equal  to  zero,1 
one  gets  the  necessary  condition  for  the  minimum.   Solving 
for  the  least  squares  estimator  of  the  slope  yields: 

£XY  -   ZX  EY 
n 


Ex2  _  (ZX) 


n 
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Once  the  estimated  slope,  b,  is  known,  the  estimated  inter- 
cept, a,  is  easy  to  compute: 

-   .-    EY   .   EX 
a  =  y  -  bx  =  —  -  b  —  . 

Extrapolation  of  time  series  using  phenomenological 
models  is  likely  to  be  the  best  method  of  forecasting  when- 
ever most  of  the  data  is  historical  and  exhibits  definite 
trends  in  its  development.   In  general,  the  startling  and 
unexpected  will  not  be  forecast.   Because  it  is  analytical, 

trend  extrapolation  keeps  the  role  of  the  forecaster's  bias 
at  a  minimum.   Attempts  have  been  made  to  eliminate  all  fore- 
caster bias  by  deriving  mathematical  expressions  for  the 
growth  of  technology  (see  Section  1).   While  it  is  true  that 
the  growth  can  often  be  represented  by  an  analytic  model,  as 
yet  no  particular  successful  analysis  has  taken  place.   The 
situation  is  far  too  complex  to  be  modelled  successfully  with 
present-day  technology.   Thus,  in  practice  forecasting  still 
proceeds  with  the  trend  extrapolated  manually. 

C.    MORPHOLOGICAL  ANALYSIS 

Trend  extrapolation  and  contextual  mapping  generate  new, 
though  more  or  less  inaccurate,  information  about  specific 
functional  capabilities  or  parameters  or  simple  parameter 
combinations.   They  do  not  yield  any  information  about  the 
nature  of  functional  technological  systems.   The  morphological 
method,  on  the  other  hand,  was  developed  by  Zwicky  for  iden- 
tifying, indexing,  counting,  and  parametrizing  the  collection 
of  all  possible  devices  to  achieve  a  specified  functional 

capability  [l\]  . 
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In  his  own  words  Zwicky  states  that:   "The  morphologi- 
cal approach  to  discovery  invention,  research  and  construc- 
tion has  been  conceived  and  developed  for  the  purpose  of 
dealing  with  all  situations  in  life  more  reasonably  and  more 
effectively  than  hitherto.   This  is  achieved  through  the 
study  of  all  relevant  interrelations  among  objects,  phenomena 
and  concepts  by  means  of  methods  which  are  based  on  the  ut- 
most detachment  from  prejudice  and  carefully  refrain  from  all 
preevaluations . "   In  other  words,  technology  is  considered  as 
a  system  with  various  components.   Each  component  is  consid- 
ered in  all  its  ramifications  and  then  all  permutations  are 
considered.   As  a  result  a  set  of  "inventions  on  paper"  are 
derived  which  may  be  considered  as  possible  results  of  the 
technology.   This  approach  provider  a  method  of  systematic?] i; 
exploring  all  available  opportunities. 

Perhaps  the  obvious  application  of  this  technique  is  in 
the  analysis  of  technological  opportunities .   Apart  from  the 
chance  of  using  the  scheme  to  anticipate  actual  inventions, 
there  is  at  least  a  possibility  of  parametrically  character- 
izing the  optimum  configuration  for  a  particular  mission  or 
task . 

Again,  to  quote  Zwicky  [1]:   "There  are,  in  particular 
three  types  of  generic  problems  which  the  morphological  ana- 
lysis attempts  to  solve.   These  are: 

How  much  information  about  a  certain  limited  set  of 
phenomena  can  be  obtained  with  the  help  of  a  given  class  of 
devices?   Or,  stated  differently,  what  devices  are  necessary 
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to  obtain  all  of  the  information  about  a  given  set  of  phenom- 
ena? 

What  is  the  sequence  of  all  effects  issuing  from  a  cer- 
tain cause? 

Deduce  all  of  the  devices  of  a  given  class,  or  all  of 
the  methods  of  a  given  class  or,  generally  speaking,  all  of 
the  solutions  of  a  given  definite  problem." 

An  answer  to  the  second  question  is  found  in  the 
relevance  tree  technique,  which  will  be  discussed  in  section 
four.   The  third  problem  is  the  crucial  one  for  exploratory 
forecasting  and  will  therefore  be  discussed  here  in  greater 
detail . 

Jantsch  summarizes  the  step-wise  solutions  to  a  generic 

plUl.lj.tlll        >^J-  i/IlC  L/ii-LJ-vJ.         U|)pO         O.C<  lUllUWb  I    Xj     < 

First,  an  exact  statement  is  made  of  the  problem  that 
is  to  be  solved.   For  instance,  one  may  wish  to  study  the 
morphological  character  of  all  modes  of  motion,  or  of  all 
possible  propulsive  power  plants,  telescopes,  pumps,  detec- 
tion devices,  and  so  on.   If  one  specific  device,  method,  or 
system  is  asked  for,  the  method  immediately  generalizes  the 
inquiry  to  all  possible  devices,  methods  or  systems  which 
provide  the  answer  to  a  more  generalized  request.   The  task 
of  formulating  the  initial  statement  or  definition  of  the 
problem  on  hand  is  exacting.   Zwicky  affirms  that  "one  is  hard 
put   to  find  in  the  existing  literature  satisfactory  defini- 
tions of  well-known  devices  like  telescopes,  pumps,  and  so 
on . 


l\2 


Second,  the  exact  statement  of  the  problem  to  be  solved, 
or  the  precise  definition  of  the  class  of  subsystems  or  com- 
ponents to  be  studied,  will  reveal  automatically  the  impor- 
tant characteristic  parameters  on  which  the  solution  of  the 
problem  depends.   For  instance,  in  the  case  of  telescopes, 
some  of  these  parameters  are  the  location  of  the  telescope 
(medium  in  which  it  is  embedded) ,  the  nature  of  the  aper- 
ture (A)  and  the  recording  device  (R),  the  nature  of  the 
changes  to  which  the  light  is  subjected  from  A  to  R,  the 
motion  of  the  telescope,  the  sequence  of  operations,  etc. 
The  second  step  thus  involves  the  study  of  ai.l  these  signifi- 
cant parameters . 


Third,  each  parameter  P.  will  be  found  to  possess 
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B.,...,P..   For  example,  the  parameter  "motion"  of  a  tele- 

12    3 
scope  may  have  the  independent  values  P  ,  P  ,  P   =  transla- 
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tion  in  three  directions;  P  ,  P  ,  P   =  rotary  motion;  etc. 

These  matrices  are  written  in  the  following  scheme: 
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If  one  element  is  encircled  in  each  matrix  and  all  the  circles 
are  connected,  every  resulting  chain  of  circles  represents 
one  possible  solution  of  the  original  problem. 
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It  is  exceedingly  essential  that  up  to  this  point  no 
question  be  asked  as  to  what  value  one  or  the  other  solution 
may  have.   Such  premature  curiosity  almost  always  defeats 
the  unbiased  application  of  the  morphological  method.   How- 
ever, once  all  of  the  solutions  are  found,  one  must  know  their 
relation  to  any  given  set  of  adopted  performance  values. 

The  fourth  step  in  the  morphological  analysis  is  the 
determination  of  the  performance  values  of  all  of  the  derived 
solutions.   The  performance  evaluation  must  be  carried  out 
on  a  universal  basis  if  one  wishes  to  avoid  getting  lost  in 
an  enormous  confusion  of  details.   This  is  not  always  an 
easy  task. 

The  fifth  and  final  step  involves  the  choice  of  par- 
ticularly desirable  special  solutions  and  their  realisation. 
The  conviction  that  all  solutions  can  be  realized,  indepen- 
dent of  time,  is  inherent  in  morphological  thought.   Since 
time  is  not  considered,  morphological  analysis  is  not  a  fore- 
cast per  se,  but  it  is  a  useful  organizing  tool,  a  source 
of  insights  and  a  starting  point  for  further  analysis. 

The  basic  method  and  its  variations  can  best  be  explained 
in  terms  of  a  specific  illustration.   Figure  8,  which  utilizes 
the  matrix  structure  discussed  under  point  3  above,  comes 
from  Zwicky  himself.   He  focused  attention  in  great  detail  on 
the  totality  of  all  jet  engines  operating  in  a  pure  medium 
(vacuum,  air,  water,  earth)  containing  simple  elements  and 
being  activated  by  chemical  energy. 

There  are  36,864  combinations  of  the  above  pure-medium 
jet  engines,  containing  simple  elements  only  and  being  activated 
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by  chemical  energy.   However,  there  are  some  technical  re- 
strictions which  reduces  the  number  of  possible  jet  engines 
to  25>3^4.   For  example,  the  distinction  in  Figure  8  between 
internal  and  external  is  meaningless  for  the  case  of  zero 
thrust  augmentation.   Obviously  many  of  these  permutations 
have  never  been  tried  out  or  even  thought  about,  i.e.,  they 
have  not  been  "invented"  yet.   Even  if  we  disregard  jets 
designed  to  operate  in  water  or  in  the  earth  (hydrojets  and 
terrajets),  there  remain  more  than  10,000  possible  configura- 
tions of  which  only  a  small  number  have  ever  been  given  serious 
attention . 

The  example  marked  in  the  matrix  above  by  circling  spe- 
cific parameters  is  the  interplanetary  aeroduct  or  ramjet. 


^w±cKy  remarks  >  that  'the  principal  point  c:  interest  is  the 

2 
presence  of  the  element  P  ,  in  the  above  matrix.   It  means 

that  the  chemical  energy  is  derived  entirely  from  the  sur- 
rounding medium  and  that  the  jet  engine  operates  although  it 
does  not  carry  any  propellants  with  it  at  all."   One  way  to 
achieve  this  characteristic  is  to  make  use  of  the  sun's 
energy  which  is  stored  in  the  upper  atmosphere   in  the  form 
of  excited  and  ionized  atoms  and  molecules.   The  inclusion 
of  a  jet  which  conceivably  might  use  this  stored  energy  would 
stimulate  research,  to  find  out  about  the  nature  and  number 
of  the  excited  particles  and  research  in  the  possibilities 
of  de-exciting  the  particles  and  using  the  energy  gained  in 
aeroducts,  aeropulses,  and  other  devices  for  the  generation 
of  propulsive  power.  It  is  believed  that  such  gradual  and 
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and  continuous  acceleration  might  ultimately  prove  to  be 
superior  to  the  use  of  nuclear  propulsion  for  space  ships 
leaving  the  earth . 

The  practical  application  of  the  morphological  method 
is  conceivable  over  a  wide  spectrum.   It  allows  forecaster's 
to  see  important  interactions  between  various  branches  of 
science,  such  as  physics,  chemistry,  biology,  etc.   Fre- 
quently a  modest  advance  in  one  discipline  may  have  a  dynamic  im- 
pact on  a  seemingly  unrelated  branch  of  science.   The  basic 
attitude  of  this  technique  can  certainly  be  found  in  many 
forms  of  technological  planning.   The  full-size  application 
of  this  technique  as  it  has  been  practiced  by  Zwicky,  has 
had  considerable  success  in  rocket  and  jet  fuel  development. 
He  also  derived  the  possibilities  of  making  the  moon  habit- 
able and  even  went  so  far  as  to  investigate  the  possibility 
of  changing  planetary  orbits  to  make  them  habitable. 

D.    SCENARIO  WRITING 

The  term  "scenario  writing"  denotes  a  technique  which 
attempts  to  set  up  a  logical  sequence  of  events  in  order  to 
show  how,  starting  from  the  present,  a  future  state  might 
evolve  step  by  step.   The  purpose  of  a  scenario  is  not  to 
predict  the  future.   It  refines  information  on  the  forsee- 
able  "climate"  for  various  branches  of  science  rather  than 
outlining  probable  technological  achievements.   Prehoda 
states  that  many  of  the  best  science  fiction  stories  are 
based  on  refined  scenarios,  and  some  science  fiction  authors 
have  been  good  technological  forecasters,  e.g.,  Jules  Verne 

[11]. 
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Perhaps  the  most  authoritative  discussion  of  the  purposes 
and  values  of  scenario  writing  may  be  found  in  the  writings 
of  Herman  Kahn  [15] .   Kahn  cites  two  advantages  worth  noting: 
First,  scenarios  are  an  effective  tool  to  force  the  analyst 
to  plunge  into  the  unfamiliar  and  rapidly  changing  world  by 
dramatizing  and  illustrating  the  possibilities  they  focus  on. 
Second,  scenarios  are  an  antidote  for  concentrating  exclusive- 
ly on  the  forest  and  ignoring  the  trees.   They  force  the  ana- 
lyst to  deal  with  details  and  dynamics  which  he  might  easily 
avoid  treating  if  he  restricted  himself  to  abstract  consider- 
ations.  Typically,  no  particular  set  of  the  many  possible 
sets  of  details  and  dynamics  seems  specially  worth  treating, 
so  none  are  treated,  even  though  a  detailed  investigation  of 

Kahn  himself  warns  of  the  dangers  that  may  arise  from 
the  use  of  scenarios  to  guide  and  facilitate  further  thinking 
and  analysis.   Specifically,  the  initial  conjectures  might 
erroneously  be  assumed  to  be  sufficiently  correct  to  lead  to 
scenarios  with  some  content  of  "reality."   However,  as  Kahn 
remarks,  "a  specific  estimate,  conjecture,  or  content,  even 
if  it  is  later  shown  to  have  serious  defects,  is  often  better 
than  a  deliberate  blank  which  tends  to  stop  thought  and  re- 
search .  " 

An  interesting  version  of  scenario-writing,  combined 
With  cost/effectiveness  analysis  has  been  given  by  Ayres  in 
the  food  production  area  [16]  .   Essentially  it  attempts  a 
critical  evaluation  of  the  fundamental  alternatives  (such  as 
non-photosynthetic  energy  sources)  on  economic  grounds  and 
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in  broad  contexts  -  resulting  in  the  rejections  of  some  much 
discussed,  technically  feasible  solutions.   He  points  out 
that  this  approach  merits  particular  attention  in  the  area 
of  "social  engineering." 

Scenario-writing  is  also  applied  by  several  of  the  big 
oil  companies  which  are  deeply  interested  in  future  economic 
political,  and  social  environments  [1] .   It  is  also  applied 
by  Honeywell  to  determine  and  assess  higher-level  goals  and 
missions  for  their  PATTERN  scheme.   PATTERN  will  be  discussed 
in  the  following  section. 

A  variation  of  scenario  writing  -  but  having  the  aim  of 
simulating  "reality"  is  iteration  through  synopsis.   This 
method  consists  of  writing  scenario's  in  six  different  fields 
( demography ,  psychology 3    sociology s  technology,  politics,  and 
economics)  and  subsequently  combining  them.   The  individual 
scenarios,  especially  the  economic  one,  could  be  partially 
derived  by  more  rigid  techniques  such  as  econometric  or 
statistical  analysis. 

In  the  Department  of  Defense  the  study  of  future  poten- 
tial threats  by  scenario-writing  is  a  major  activity  involv- 
ing annual  expenditures  in  the  millions  of  dollars  [4]. 
Similar  scenario  studies  are  carried  out  by  NATO  and  other 
agencies.   Although  consideration  of  the  potential  impact  of 
technological  break  throughs  on  the  future  military  -  politi- 
cal -  social  environment,  via  scenario-writing,  is  not 
currently  a  major  component  of  the  above  mentioned  activities, 
it  has  shown  tremendous  potential  for  future  forecasting 
exercises  [  -I]  . 
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E.    UNCERTAINTY  TECHNIQUES 

Technological  forecasting  is,  by  definition,  an  area 
deeply  concerned  with  uncertainty.   However,  too  often  the 
forecasts  that  are  presented  to  decision  makers  fail  to  in- 
clude an  explicit  description  of  the  inherent  uncertainties. 
Three  techniques  developed  by  Research  Analysis  Corporation 
are  described  that  can  be  used  to  convey  such  information 
to  decision  makers  [2].   They  are  based  on  probability 
theory  and  permit  the  construction  of  probability  distri- 
butions of  total  projects  from  the  distribution  of  individual 
parameters . 

The  basic  assumption  of  each  of  these  techniques  is 
that  forecasting  inputs  such  as  growth   rates  and  R&D  costs 
can  be  considered  cc  ce  random  variables  which  nave  prob- 
ability  distributions .   The  techniques  then  combine  these 
distributions  in  accordance  with  the  equations  of  the  par- 
ticular forecasting  model  to  produce  probability  distribu- 
tions instead  of  single  point  estimates  for  demand  and/or 
capability  projections.   The  techniques,  which  differ  only 
in  method  of  combination  of  distributions,  are  enumerated 
and  briefly  described  below. 

The  first  technique  derives  the  moments  of  the  distri- 
bution curve.   The  moments  are  a  set  of  mathematical  proper- 
ties which  are  capable  of  completely  defining  a  particular 
distribution  [1] .   Moreover,  these  can  be  combined  by  certain 
mathematical  formulae  to  produce  corresponding  moments  for 
any  combination  of  sums  and  products  of  curves .   This  techni- 
que can  be  used  to  convert  user-  specified  parameters  to  the 
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moments  of  their  distributions;  combine  these  moments  in  the 
manner  specified  by  the  forecasting  model;  and  reconvert  this 
combination  of  moments  to  the  distribution  it  describes. 

The  second  method  is  the  Monte  Carlo  technique.   In 
this  method,  many  iterations  of  the  same  forecasting  model 
are  run,  each  of  which  changes  the  inputs  of  the  model  in 
accordance  with  random  values  drawn  from  the  probability 
distributions  of  the  inputs.   After  a  number  of  such  itera- 
tions, a  frequency  curve  can  be  developed  for  the  model's 
outputs . 

The  third  and  final  technique  is  called  symmetric  ap- 
proximation.  This  method  employs  the  same  basic  approach 
as  the  derivation  of  moments  technique,  but  utilizes  certain 
approximating  relationships  Lo  determine  the  rnoTaents  of  the 
distributions.   To  date,  tests  at  Research  Analysis  Corpora- 
tion have  been  run  utilizing  Beta  distributions .  This  is  a 
type  of  distribution  which,  in  its  symmetric  form,  resembles 
a  bounded  normal  distribution.   However,  it  differs  from 
the  normal  in  that  it  can  reflect  skewness  or  flatness  - 
traits  which  often  prove  valuable  for  expressing  uncertainty. 

For  all  three  techniques  the  user  must  select  a  most- 
likely  value  (presumably  this  would  correspond  to  the  input 
that  the  user  would  specify  if  producing  only  a  single  point* 
projection),  the  high  value,  and  the  low  value.   In  addition, 
the  user  selects  a  type  of  distribution  from  a  fixed  set  of 
distributions  which  can  be  described  qualitatively  in  terms 
of   skewness   and   variance".   With   these  user-specified 
parameters   as   inputs,   each  technique   can  produce  proba- 
bility  distributions   for   the   projections   which   result 


from  the  particular  forecasting  models.   An  example  will  help 
to  illustrate  the  way  these  techniques  can  be  employed  by  a 
firm  for  technological  forecasting. 

Suppose  a  manager  is  interested  in  estimating  the  costs 
of  a  missile  airframe.   The  missile  is  not  yet  designed  or 
built,  so  no  production-cost  data  are  available.   The  cost 
group  has  placed  the  airframe  cost  at  $32,000,  but  the  de- 
sign group  has  warned  that  additional  sophistication  might 
raise  costs  above  this  prediction,  and  that  improvements  in 
some  manufacturing  techniques  hold  the  promise  of  lower 
costs.   Calculations  provide  estimates  as  low  as  $26,000  and 
as  high  as  $453000.   Each  of  these  calculations  is  based  on 
a  set  of  assumptions  concerning  labor  and  overhead  rates, 
material  costs  in  "Cnc  xuturc,  and  design  details  which  are 
not  yet  firm  and  are  subject  to  some  uncertainty.   After 
considering  each  factor,  the  analyst  enters  his  final  es- 
timate as  $36,000.   Obviously,  with  a  single-point  estimate 
the  analyst  is  not  telling  the  hypothetical  decision-maker 
all  he  needs  to  know  to  make  a  rational  decision. 

If  the  reasoning  that  fixed  the  relevant  range  of  costs 
at  $26,000  to  $45,000  could  yield  information  on  the  probabil- 
ities of  occurence,  the  techniques  described  above  could  de- 
velop the  missing  information.   From  this  information,  a 
probability  distribution  for  costs  of  the  airframe  could  be 
developed.   When  combined  with  similarly  determined  distribu- 
tions of  other  cost  components,  total  missile  cos-t  could  be 
obtained,  or  even  total  system  cost  if  other  equipment  is  to 
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be  costed.   The  techniques  would  produce  statistical  measures 
of  the  distribution  of  total  cost,  including  the  mean  and 
variance.   It  would  also  provide  a  graphical  display  of  the 
total  cost  range  implied  by  the  uncertainties  associated  with 
the  input  parameters . 

Caution  is  necessary  in  using  these  techniques.   Two  as- 
sumptions are  made  that  may  not  be  valid  in  every  situation. 
The  first  is  that  the  user  can,  in  fact,  specify  a  distribu- 
tion type  and  the  required  parameters  of  that  distribution. 
This  assumption  highlights  the  twofold  nature  of  the  problem 
the  decision-maker  faces.   He  must  first  obtain  the  inputs 
required  for  the  specification  of  the  distribution  and  then 
he  must  process  the  distribution  into  a  form  which  is  useful 
to  the  decision— maker .   The  second  assumption  is  that  the 
input  variables  are  independent  or  that  their  dependence  can 
be  made  explicit.   Research  in  this  latter  area  has  produced 
a  number  of  ways  of  determining  such  explicit  relationships 
but  has  not  eliminated  this  constraint  altogether  [2], 

F.    COST/BENEFIT  ANALYSIS 

Cost/benefit  analysis  does  not  add  any  new  information 
to  technological  forecasting.   However,  it  is  used  to  trans- 
late estimates  resulting  from  technological  forecasting  into 
economic  terms.   Cost/benefit  analysis  in  the  context  of 
technological  forecasting  is  thus  a  special  technique  for 
binding  together  a  vertical  and  a  horizontal  forecast  to  form 
an  integral  forecast.   This  process  makes  possible  an  inte- 
gral view  for  decision-making  by  placing  the  vertical  and 
horizontal  effort  on  the  same  basis  . 

53 


The  vertical  forecast,  usually  attempted  at  the  advan- 
ced development  stage  and  again  at  the  engineering  stage, 
provides  estimates  on  the  development  time  and  costs,  pro- 
duction and  operating  costs  and  other  operational  character- 
istics.  The  horizontal  forecast  provides  estimates  on  sales 
and  profits  as  a  function  of  time.   Risk  factors  may  also 
be  estimated  for  both  the  vertical  forecast  (technical  risk) 
and  the  horizontal  forecast  (commercial  risk).   As  one  might 
expect,  the  combination  of  the  two  forecasts  gives  cost  flows 
as  a  function  of  time. 

In  industry  there  are  several  performance  indices  of 
which  the  most  widely  used  in  "return  on  capital  investment" 
[1] .   This  is  not,  however,  a  uniquely  defined  concept,  since 
there  arc  a  number  of  different  methods  of  measuring  return. 
This  approach  does  not  consider  time  explicitly  and  the  ef- 
fect of  interest  gained  or  lost  over  time.   Although  it 
neglects  this  very  foundation  of  business  thinking,  it  is 
widely  used  on  the  assumption  that  the  time  factor  can  be 
taken  into  account  in  an  indirect  way. 

Costs   are,  of  course,  fairly  well  defined  and  straight 
forward  in  many  instances,  but  not  so  benefits.   In  the  case 
of  private  industry  it  is  only  necessary  to  consider  benefits 
to  the  corporation,  although  in  some  cases  a  very  broad  view 
may  be  taken  as  to  what  constitutes  a  benefit.   Regarding 
public  investments, .  on  the  other  hand,  it  is  necessary  to 
identify  all  the  beneficiaries,  as  well  as  those  who  may  be 
injured.   In  too  many  instances  benefits  are  computed  on  the 


54 


basis  of  considering  only  a  fraction  of  the  effects  on 
part  of  the  population,  and  ignoring  the  rest.   For  example, 
it  is  standard  practice  for  highway  departments  to  compute 
the  benefits  from  highways  only  for  road  users,  totally  dis- 
regarding the  hidden  "negative  benefits"  affecting  other 
segments  of  the  economy. 

One  of  the  best  means  of  accounting  for  the  time  fac- 
tor in  cost/benefit  analysis  is  the  method  of  calculating 
the  present  value  of  a  future  income  stream.   The  question, 
in  another  form,  is :   What  should  one  assume  for  the  effec- 
tive forward  discount  rate  r?   In  words,  the  discount  rate 
is  essentially  the  expected  rate  of  appreciation  of  alter- 
native investments  currently  available.   The  present  value 
of  a  fuLure  benefit  is  the  amount  of  money  which s  invested 
at  r  percent  per  annum,  would  ultimately  produce  a  yield 
equal  to  the  projected  benefit.   In  the  case  of  very  long- 
term  projects,  such  as  reservoir's  and  dams,  whose  benefits 
must  be  computed  over  a  time  horizon  extending  50  to  100 
years  into  the  future,  it  is  easy  to  see  that  the  calculated 
benefit  is  extremely  sensitive  to  the  discount  rate:   the 
lower  the  rate,  the  greater  the  benefit. 

The  basic  expression  of  the  "continuous"  approach  is 
the  present  net  value  P'  of  each  incremental  cash  flow  C(t) 
at  time  t'  (counted  from  t=0  for  the  present): 

P1  =  C(t')  e"rt'  dt. 

Integration  over  time  yields  the  net  present  value  of  the 
project : 
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where  C(t)  is  the  cash  flow  (or  income)  per  unit  time  at 
future  time  t.   In  general,  C(t)  is  negative  for  the  first 
few  years  after  the  initial  decision  to  invest  in  a  new  pro- 
ject with  positive  contributions  corresponding  to  profits 

coming  later  on.   Because  of  the  rapidly  decreasing  expo- 

-rt 
nential  factor  e    ,  a  project  with  a  large  but  long-delayed 

payoff  may  have  a  present  worth  much  less  than  one  whose  re- 
turn is  smaller  but  earlier.   The  above  equation  for  P(r)  can 
be  set  to  zero,  so  that  it  holds  for  break-even  conditions 
and  solved  for  r,  which  then  represents  the  inherent  rates 
of  return  of  a  project.   One  could  then  compare  the  inherent 
r  with  zhc    given  limiting  r  which  tiives  a  clearer  ranking 
order  from  high  values  of  r  down  to  the  limiting  value  of 
r.   One  may  also  decide  the  maximum  amount  of  research  pos- 
sible if  funds  have  to  be  raised  at  different  discount  rates. 
It  should  be  noted,  however,  that  there  are  well-known  dif- 
ficulties associated  with  this  approach.   A  detailed  dis- 
cussion of  this  subject  can  be  found  in  Quirin's  text  [17] • 

Ayres  cites  an  interesting  example  of  cost/benefit 
analysis  [4].   The  field  of  water-resources  development  has 
been  characterized  by  very  long  time  horizons  and  low  dis- 
count rates,  with  little  or  no  consideration  of  the  impact 
of  technological  change   on  the  assumed  benefits.   For  in- 
stance, it  is  clear  that  if  the  anticipated  benefits  of  a 
multipurpose  dam  assume  a  requirement  for  irrigation  water, 
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the  cost/benefit  calculation  should,  among  other  things, 
include  an  explicit  evaluation  of  the  potential  impact  of 
new  technologies  for  water  conservation.   At  first  glance 
this  may  involve  some  excursions  into  rather  remote  areas, 
such  as  the  development  by  American  Oil  Co.  of  a  technique 
for  "waterproofing"  cropland  from  beneath  by  injecting  a 
layer  of  asphalt  at  a  depth  of  several  feet  below  the  sur- 
face.  This  prevents  subsurface  runoff  and  increases  the 
water  supply  available  to  plants.   One  of  the  obvious  re- 
sults of  this  procedure  is  to  correspondingly  reduce  the 
demand  for  irrigation  water,  which  in  turn  influences  the 
decisions  concerning  the  size  of  the  dam. 

Looking  further  into  the  future,  cost/benefit  analysis 
may  also  be  iixpectt;d  to  become  very  valuable  tor  the  into 
gration  of  vertical  and  horizontal  forecasts  at  higher 
levels,  i.e.,  of  environments,  social  systems  or  even  society. 
The  prerequisite  for  its  use  is  the  quantification  of  fore- 
casts at  these  higher  levels  in  economic  terms  (numeraire) . 
The  author  believes  that  attempts  to  introduce  cost/effec- 
tiveness analysis,  which  has  success  in  military  administra- 
tion, into  other  parts  of  the  Government  is  a  significant 
step  in  this  direction. 

G.    OPERATIONAL  MODELS 

Abt  Associates  define  models  as  representations  of  pro- 
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cesses  describing  in  simplified  form  some  aspects  of  the 

real  world  [1].   They  are  the  mechanisms  by  which  predictions 

of  the  performance  of  a  process  or  system  can  be  made.   Generally 
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the  analyst  attempts  to  duplicate  in  some  kind  of  model  the 
behavior  of  the  parameters,  subsystem,  or  system  with  which 
he  is  working.   Once  he  has  achieved  this  relationship  be- 
tween the  real  world  situation  and  his  model*  he  can  manipulate 
the  model  to  study  the  characteristics  in  which  he  is  inter- 
ested. 

Models  provide  some  of  the  most  effective  means  for  pre- 
dicting performance.   It  is  hard  to  conceive  of  a  prediction 
system  which  is  not  in  some  sense  a  model.   To  construct  a 
model  of  a  real  process  or  system,  careful  consideration  of 
just  which  elements  need  to  be  abstracted  is  required.   This 
in  itself  is  usually  a  worthwhile  activity,  for  it  develops 
insights  into  the  problem. 

The  purpose  in  constructing  a  model  of  a  given  situa- 
tion is  to  single  out  certain  elements  as  being  relevant  to 
the  problem  under  consideration,  to  make  explicit  certain 
functional  relationships  among  these  elements,  and  to  for- 
mulate hypotheses  regarding  the  nature  of  these  relation- 
ships.  These  functional  relationships  enable  the  analyst  to 
express  the  model  in  mathematical  form.   In  this  way  he  is 
able  to  determine  the  most  appropriate  action  to  take  in  the 
face  of  a  given  situation. 

The  advantage  of  employing  a  model  lies  in  forcing  the 
analyst  to  make  explicit  what  elements  of  a  situation   he  is 
taking  into  consideration  and  in  imposing  upon  him  the  dis- 
cipline of  clarifying  the  concepts  he  is  using.   It  should 
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be  noted  that  in  this  connection  the  use  of  numerical  parame- 
ters, and  thus  of  a  mathematical  model,  is  simply  a  device 
for  conceptual  clarification. 

A  type  of  model  which  should  prove  of  special  importance 
in  the  area  of  technological  forecasting  is  the  simulation 
model.   Abt  Associates  define  simulation  as  the  operation  of 
a  model  by  manipulations  of  its  elements  by  a  computer,  a 
human  player,  or  both.   Here  instead  of  formulating  hypothe- 
ses and  predictions  directly  about  the  real  world,  it  is  pos- 
sible to  make  such  statements  about  the  properties  of  the 
model.   Any  results  obtained  from  an  analysis  of  the  model, 
to  the  extent  that  it  truly  simulates  the  real  world,  can 
then  later  be  translated  back  into  corresponding  statements 

Among  the  simulation  models  are  a  number  of  different 
varieties.   There  are  paper-and-pencil  models,  usually  in- 
volving sets  of  mathematical  equations.   These  can  be  ana- 
lyzed by  standard  techniques,  or,  if  their  complexity 
precludes  this,  their  implications  can  be  explored  with 
electronic  computers  for  any  number  of  input  parameter  values 
Then  there  are  physical  simulation  models  such  as  might  be 
used  in  the  study  of  urban  development.   Here  the  projected 
stages  of  transformation  of  a  city  may  be  displayed  with  the 
aid  of  a  miniature  mock-up. 

A  particularly  useful  kind  of  physical  simulation  is 
that  of  operational  gaming.   It  involves  role-playing  by 
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human  subjects  in  a  laboratory  situation  in  which  the  parti- 
cipants simulate  real  world  decision-makers  in  a  conflict  of 
interest  setting. 

Gaming  has  been  used  in  forecasting  the  possible  impact 
of  new  or  future  technologies  and  it  has  been  used  for  some 
time  in  this  connection  by  military  administrations,  mainly 
for  studying  the  implications  for  the  future  of  combinations 
of  specific  technological  and  strategic  concepts,  from  the 
viewpoint  of  both  one's  own  forces  and  those  of  the  enemy  [1] 
With  forecasting  assuming  ever-increasing  importance,  gaming, 
using  appropriate  constraints  on  the  moves  of  both  players, 
may  become  a  valuable  technique  for  the  evaluation  of  alter- 
native technological  developments.   Gaming  can  be  extended 
to  study  complex  problems  facing  society  and  is  'r>ccr:rrrLnz   rec- 
ognized  as  one  of  the  potentially  most  suitable  techniques 
for  "social  engineering"  [18] . 

H.    INPUT/OUTPUT  ANALYSIS 

Leontief  has  high  hopes  that  input/output  analysis  might 
become  useful  for  technological  forecasting  [19].   Originally 
the  interest  in  the  application  of  input/output  analysis  to 
forecasting  was  stimulated  by  the  hope  of  improving  the  fore- 
casting of  the  two  common  relationships  between  input  and    v 
output;  (a)  the  "production  function/'  expressing  the  output 
in  terms  of  major  inputs,  such  as  labor  and  capital;  (b)  the 
trend  of  labor  productivity  ratio  over  time. 

The  dynamic  use  of  input/output  analysis  has  become  the 
principal  object  of  study  by  Almon  [20].   He  has  built  a 
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computer  model  for  an  inter-industry  forecast  up  to  1975. 
Forecasting  the  United  States  economy  from  input/output 
tables  is  restricted  to  "hindsight"  as  long  as  the  prepara- 
tion of  the  tables  lags  behind  in  time.   However,  input/ 
output  analysis  has  already  become  a  valuable  technique  for 
use  in  connection  with  manpower  and  unemployment  problems 

[1]. 

A  Rand  Corporation  study  for  the  Air  Force,  on  the  basis 
of  input/output  analysis,  attempted  to  forecast  the  creation 
of  new  industries  in  the  aerospace  industry  [1] .   Arthur  D. 
Little,  Inc.  applied  input/output  analysis  to  the  identifica- 
tion of  suitable  research  and  development  programs  in  the 
field  of  oceanography  [1]. 

C::c  may  expect  that  such  analysis  will  be  recognized  is 
a  valuable  means  of  studying  structural  changes  in  a  clear 
and  explicit  manner.  General  trends  -  such  as  the  increase 
in  volume  of  activity  for  the  services,  the  invasion  of  one 
industrial  sector  by  another,  the  changes  in  the  supply  and 
demand  of  raw.  materials,  and  many  others  -  can  be  followed 
explicitly . 

The  attractive  feature,  therefore,  of  the  input/output 
approach  is  that  irregularities  in  the  trend   curves  show 
up  explicitly,  often  in  terms  of  readily  identifiable-  causes 
such  as  "bottlenecks"  in  the  number  of  servicemen  or  of  es- 
sential experimental  facilities  in  a  new  field.   For  example, 
superconductivity  cannot  be  investigated  on  any  reasonable 
scale  without  a  helium  liquifier  for  the  laboratory  [4]. 
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The  unattractive  feature  is  simply  that  in  many  cases 
the  amount  of  quantitative  methods  required  is  too  great  in 
relation  to  the  conclusions  one  can  reasonably  expect  to 
arrive  at  [4]  .   The  cumulative  uncertainities  due  to  com- 
bining and  manipulating  a  large  number  of  equations  and 
proportionality  constants,  each  one  of  which  is  likely  to  be 
individually  imprecise,  must  be  such  as  to  make  the  net  re- 
sult often  little  better  than  a  guess. 

At  the  present  state  of  the  art  it  is  the  author's 
opinion  that  it  is  difficult  to  consider  input/output  ana- 
lysis seriously  as  a  long-range  forecasting  tool.   Ayres 
points  out,  however,  that  it  may  be  extremely  useful  as  a 
teaching  device  for  analysts  and  decision-makers  and  as  such 
is  a  worthwhile  contribution  to  the  general  discussion  of 
exploratory  forecasting  techniques  [^]. 
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IV.   NORMATIVE  FORECASTING  TECHNIQUES 

A.    INTRODUCTION 

Exploratory  technological  forecasting  as  stated  previous- 
ly starts  from  today's  basis  of  knowledge  and  is  oriented 
towards  the  future.   Normative  technological  forecasting,  on 
the  other  hand,  first  assesses  future  goals,  needs,  desires 
and  missions  and  works  backward  to  the  present  to  see  what 
capabilities  now  exist  or  could  be  extrapolated  to  meet 
future  goals  [1] .   Bright  cites  the  Navy's  "Polaris"  Program 
and  NASA's  "Man  on  the  Moon"  Program  as  two  good  examples  of 
"needs-oriented"  normative  forecasting  [2] . 

Jantsch  states  that  normative  technological  forecasting 
is  mtjcuiiiigful  on_iy  if  two  conditions  prevail  |_i]  .   Pirst, 
normative  forecasting  is  applicable  only  in  a  "closed" 
society.   That  is,  if  the  levels  to  which  it  is  applied  are 
characterized  by  constraints,  then  normative  forecasting  can 
be  applied  only  if  the  needs  or  missions  are  "closed"  by 
natural  or  artificial  forces  or  by  consensus.   For  example, 
they  could  be  "closed"  by  an  agreed  set  of  values  or  ethical 
directives.   Second,  normative  forecasting  depends  on  an 
abundance  of  opportunities.   That  is,  if  more  opportunities 
exist  and  are  recognized  on  these  levels  than  can  be  exploited 
under  the  given  constraints,  then  normative  forecasting  can 
be  applied  and  is  essentially  an  attempt  to  select  an  optimum 
among  the  recognized  opportunities. 

The  author  believes  the  first  of  the  two  conditions  for 
normative  forecasting  -  a  "closed"  system  -  will  be  less 
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readily  accepted  by  a  democratic  society  unless  the  program 
is  well-defined.   The  basic  difficulty  with  a  "closed"  system 
within  a  democratic  society  is  the  problem  of  general  con- 
sensus .   Brooks  points  to  the  necessity  for  widespread  con- 
sensus in  areas  where  individual  interests  are  involved  [5] • 
For  example,  consider  urban  transportation  and  pollution  con- 
trol in  contrast  to  the  space  program,  where  few  people  have 
to  be  convinced  in  spite  of  the  large  public  expenditure  in- 
volved. 

The  search  condition  -  an  abundance  of  opportunities  - 
is,  in  the  author's  opinion,  the  situation  as  it  exists 
today.   To  illustrate  this  point  reference  is  made  to  the 
results  of  a  study  conducted  by  the  National  Planning  As- 
sociation [1]  .   If  the  United  states  undertook  to  ac^cvr 
all  its  present  national  goals,  it  would  cost  fifty  per 
cent  more  than  the  total  Gross  National  Product  in  this 
period.   The  abundance  of  opportunities  is  further  emphasized 
in  a  McGraw-Hill  survey  of  research  and  development  in  United 
States  industry  in  which  only  twenty  four  per  cent  of  a  com- 
plete cross  section  of  industry  indicated  "lack  of  profitable 
projects"  as  the  major  obstacle  to  the  performance  of  more 
research  and  development  [1]. 

A  survey  of  the  literature  on  normative  forecasting 
techniques  indicates  that  most  techniques  bear  a  strong  re- 
lationship to  the  methods  employed  in  operations  research/ 
system  analysis.   Since  many  practitioners  consider  each  to 
be  a  subset  of  the  other,  the  author  will  not  attempt  to 
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differentiate  between  the  two.   However,  it  is  worth  noting 
that  the  operations  research/systems  analysis  framework  is 
designed  to  aid  decision-makers  in  choosing  a  course  of  action 
by  investigating  his  full  "problem"  and  that  technological 
forecasting  in  this  sense  is  but  a  part  of  this  overall  "prob- 
lem."  The  Rand  report  edited  by  Quade  is  recommended  as  an 
excellent  treatment  of  the  contrasts  and  similarities  of 
operations  research  and  systems  analysis  [21] . 

The  subject  matter  of  operations  research/systems  ana- 
lysis is  indeed  vast  and  includes  a  large  number  of  areas 
not  explicitly  relevant  to  technological  forecasting.  How- 
ever3  techniques  such  as  mathematical  programming,  decision 
matrices,  network  analysis,  and  relevance  or  decision-trees 
have  found  practical  use  in  normative  forecasting.  This 
section  includes  a  description,  possible  application,  and  a 
critique  of  these  techniques. 

It  is  important  to  note  that  scenario  writing,  uncer- 
tainty techniques,  cost/benefit  analysis,  operational  models, 
and  input/output  analysis,  which  have  been  discussed  in  Sec- 
tion III,  are  also  techniques  from  the  field  of  operations 
research/systems  analysis.   Although  these  techniques  are 
discussed  in  the  opportunity-oriented  framework  of  explora- 
tory forecasting,  the  author  believes  such  techniques  are 
useful  in  the  mission-oriented  sense  of  normative  forecasting 
and  that  perhaps  a  combination  of  the  two  techniques  is  best. 
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B.    MATHEMATICAL  PROGRAMMING 

A  method  of  solving  the  problem  of  optimization  of  pro- 
ject selection  is  to  maximize  the  total  net  value  of  projects 
under  a  budget  constraint.   This  reasoning  has  intuitive  ap- 
peal since  planned  activities  undertaken  to  achieve  an  objec- 
tive usually  depend  on  decisions  which  are  influenced  by 
cost.   The  most  common  form  of  models  using  operations  re- 
search/systems analysis  techniques  is  thus  found  to  be  a  com- 
bination of  economic  analysis,  chiefly  to  determine  the 
present  net  value  of  projects  from  estimated  characteristics, 
and  operations  research/systems  analysis  techniques. 

Mathematical  programming  techniques  as  described  in 
Jantsch's  text  have  been  applied  in  several  models  [1].   For 
example,  Asher  has  developed  a  linear  programing  model  fur 
a  pharmaceutical  company.   The  variables  used  in  the  model 
include  possible  research  projects,  value  of  success,  cost 
per  man-hour,  available  man-hours,  and  available  chemicals. 
The  ranking  criterion  is  the  maximum  expected  net  value, 
taking  into  account  availability  of  man-hours  and  chemicals. 

One  of  the  most  ambitious  mathematical  programming 
models  to  date  is  Program  Analysis  for  Resource  Management 
(PARM) .   PARM  is  essentially  a  simulation  model  using  linear 
programming  techniques  for  providing  guidance  to  the  Director 
of  the  Office  of  Emergency  Planning  in  the  Executive  Office 
of  the  President  on  resource  allocations  and  the  coordination 
of  economic  mobilization  plans  among  the  major  agencies  of 
the  United  States  government  [4].   The  model  involves  keeping 
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track  of  1,007  distinct  "activities"  (or  sectors)  and  approxi- 
mately 9^^000  time-dependent  coefficients  which  describe  the 
relationships  among  the  activities.   PARM  is  a  very  sophisti- 
cated input/output  model  of  the  type  discussed  previously  in 
Section  III.   However 3    it  is  designed  to  fulfill  the  mission- 
oriented  requirement  of  project  selection  and  is  therefore 
treated  as  a  normative  forecasting  technique. 

C.    DECISION  MATRICES 

The  most  common  use  of  a  matrix  in  normative  forecast- 
ing is  for  the  optimization  of  resources  under  given  con- 
straints [1].   Resources  in  this  context  may  be  not  only 
financial  but  may  include  manpower,  skill,  research  or  manu- 
facturing resources.   The  matrix,  in  this  case,  represents 
an  input/output  matrix  of  scientific  and  technical  effort 
in  various  fields . 

An  example  of  project  selection  based  on  two-dimension- 
al resource  matrices  can  be  found  at  the  Boeing  Company  [1] . 
First,  one  matrix  is  built  for  each  project,  showing  the 
tasks  and  disciplines  involved  as  one  dimension,  and  the 
comparing  resources  as  the  other  dimension.   Projects  cor- 
responding to  the  given  resource  structure  are  then  combined  into 
higher-dimension  matrices   all  the  way  up  to  "master"  matrices 
for  broad  company  activity  areas.   These  "master"  matrices  are 
systematically  used  by  Boeing  as  an  auxiliary  means  of  achiev- 
ing optimum  deployment  of  resources. 

An  example  of  a  three-dimensional  matrix,  called  "Pro- 
gram Cube  Concept,"  and  applied  by  International  Minerals  and 
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Chemicals,  is  described  by  Jantsch  [1] .   It  has  the  three 
dimensions  of  market  missions,  resources  and  time.   The  re- 
source dimension  is  structured  into  financial,  personnel, 
marketing,  sales,  production,  facilities,  raw  material  mar- 
kets, research  and  development,  and  public  relations  re- 
sources.  Program  planning  in  this  Illustration  affects  the 
whole  cube.   Whereas  the  market  missions  and  resource  di- 
mensions, in  a  manner  analogous  to  the  Boeing  concept,  aid 
in  optimizing  the  use  of  company  capacity  at  a  given  moment, 
the  dimension  of  time  assures  continuity  of  development  in 
the  various  fields  of  interest . 

D.    NETWORK  ANALYSIS 

The  network  techniques,  especially  CPM  (Critical  Path 
Method)  and  PERT  (Program  Evaluation  and  Review  Technique) 
are  a  management  tool  for  the  control  of  complex  system  de- 
sign and  production  tasks.   CPM  is  based  on  a  "flow  chart" 
scheme  showing  the  different  steps  of  all  branches  of  the 
project.   The  branches  are  analyzed  in  order  to  select  an 
optimum  "path"  between  the  first  and  the  last  stages,  where 
the  criterion  for  an  optimum  may  be  lowest  cost,  shortest 
time,  etc.   PERT,  developed  for  the  Polaris  missile  program, 
is  a  probabilistic  approach  characterized  by  an  analysis  of 
uncertain  input  data  and  input  relationships  (for  example, 
uncertain  time  of  completion  of  a  sub-system)  and  the  calcu- 
lation of  the  probabilities  of  time  and/or  cost  factors  in 
the  entire  project.   An  excellent  reference  for  the  applica- 
tion of  CPM  and  PERT  to  project  selection  is  by  Moder  and 

Phillips  [22]. 
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In  the  analysis  of  the  requirements  for  a  project  whose 
end  point  is  well  defined,  the  nodal  points  (events)  of  the 
network  are  specific  activities.   The  first  step  of  a  network 
analysis,  according  to  Ayres,  is  to  identify  all  pertinent 
activities  and  their  causal  relationships  and  then  draw  the 
appropriate  connections  as  directed  lines  on  a  chart  [4], 
The  length  of  the  lines  in  this  case  have  no  particular 
significance.   The  logically  possible  causal  relationships 
between  two  events  A  and  B  are  as  follows:   A  is  a  prerequisite 
of  B,  B  is  a  prerequisite  of  A,  or  none.   In  the  latter  case 
A  and  B  are  independent  and  can  be  carried  out  simultaneously 
or  in  any  order  which  happens  to  be  convenient. 

Once  the  activity  times  are  specified  -  either  deter- 
minictically  in  the  case;  of  wr?;  or  probabilistically  in  the 
case  of  PERT  -  the  minimum  total  time  for  the  project  can  be 
found  by  comparing  the  elapsed  time  of  all  paths  through  the 
network,  and  identifying  the  longest  or  so-called  "critical 
path."   On  all  other  paths  there  is  some  leeway  or  slack 
time  for  adjusting  the  starting  time  to  allocate  scarce  man- 
power resources  most  efficiently  or  to  satisfy  other  con- 
straints.  This  slack  time  for  a  particular  activity  is  simply 
the  difference  between  the  earliest  and  latest  possible 
starting  times.   Hence,  one  of  the  advantages  of  this  method' 
is  revealed  by  the  ease  with  which  such  questions  as  when  to 
start  an  activity  can  be  answered. 

The  complex  series-parallel  interrelationships  found  in 
the  Polaris  Missile  Program,  requires  an  extension  of  the 
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above  discussion.   The  use  of  PERT  is  largely  credited  with 
the  successful  coordination  of  the  several  thousand  con- 
tractors and  agencies  participating  in  the  Polaris  program, 
advancing  the  completion  data  by  more  than  two  years  [23]. 
As  a  result  of  its  success  in  the  Polaris  program,  PERT 
techniques  have  been  applied  to  such  programs  as  the  Air 
Force's  Minuteman,  Skybolt,  Dyna-Soar,  and  B-70,  the  Army's 
Nike-Zeus,  Pershing  and  Hawk,  and  the  Navy's  Eagle  and 
Missileer.   American  private  industry  has  also  adopted  PERT 
to  assist  in  the  management  of  projects  which  involve  many 
interrelated  activities  [23]. 

E.    RELEVANCE  TREES 

The  relevance  tree  concept  was  first  proposed  by 
Churchman,  et    at.    in  connection  with  decision-making  in 
general  industrial  contexts  [2H]  .   Ayres  defines  a  relevance 
tree  as  a  logical  network  designed  explicitly  to  elucidate 
the  degree  of  importance  of  various  "inputs"  (e.g.,  projects) 
to  a  broadly  defined  outcome  or  goal  [^].   Questions  which 
can  be  elucidated  with  the  assistance  of  such  a  "tree"  in- 
clude optimum  allocation  of  fixed  resources  to  maximize  the 
value  of  research  and  development  and  the  optimum  selection 
of  research  and  development  program  content.   Where  the  ob- 
jective is  a  specific  one  which  has  already  been  labeled  a 
"program"  -  as  in  the  case  of  controlled  thermonuclear 
power  -  a  tree  of  prerequisites  and  alternatives  is  a  possi- 
ble starting  point  for  a  critical  path  network  analysis  as- 
sociated with  a  detailed  plan  of  action. 
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The  relevance  tree  approach  is  particularly  well  suited 
for  guiding  decisions  involving  a  large  number  of  technolog- 
ical alternatives  such  as  weapon  systems,  new  product  develop- 
ments, and  research  projects.   It  can  be  explained  and 
discussed  best  by  describing  a  particular  model  for  facili- 
tating such  choices. 

The  first  large-scale  application  of  relevance  trees 
to  numerical  analysis  for  decision-making  has  been  made  by 
Honeywell's  Military  and  Space  Sciences  Department.   The  pro- 
cess is  called  PATTERN,  an  acronym  for  Planning  Assistance 
Through  Technical  Evaluation  of  Relevance  Numbers  [25]. 
PATTERN  consists  of  three  basic  parts.   First,  a  relevance 
tree  which  measures  the  relative  importance  to  the  national 
objectives  of  upgrading  a  particular  mission  or  technical 
area.   Second,  status  and  timing  which  measures  industry's 
capability  to  solve  the  identified  problems.   Third,  cross 
support  which  measures  the  degree  of  technical  growth  that 
will  result  from  solving  a  specific  problem. 

A  scenario  which  projects  the  world  environment  (in- 
cluding military,  political,  and  economic  factors)  and  a 
comprehensive  state-of-the-art  technological  forecast  are 
used  as  basic  inputs  in  the  evaluation  process.   A  team  of 
experts  using  decision  criteria  and  subjective  probability 
techniques,  assign  quantitative  values  relating  to  the  im- 
portance of  upgrading  that  item  in  terms  of  its  contribution 
to  meeting  the  overall  national  objectives  for  the  time 
period  in  question.   Cross  support  and  status  and  timing  fac- 
tors are  also  assigned  numerical  values.   These  numerical 
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inputs  are  then  fed  into  a  computer  program  and  the  output 
of  a  model  "run"  is  a  set  of  relevance  numbers  (or  relative 
priorities)  for  listed  projects,  systems,  or  technologies 
in  terms  of  its  relative  importance  to  the  national  military 
stature  as  compared  to  all  other  areas  used  in  the  evalua- 
tion process . 

The  relevance  tree  used  in  PATTERN  is  basically  a  struc- 
tured decision  network  consisting  of  eight  levels  beginning 
with  national  security  objectives  and  progressing  through 
types  of  conflicts,  forms  of  conflicts,  missions,  systems 
concepts,  functional  subsystems,  subsystem  configurations 
and  technology  deficiencies,  in  a  tree-like  organization. 
The  structure  of  the  general  relevance  tree  is  shown  in 
Figure  3 . 

The  structure  is  first  divided  into  three  major  parts. 
At  the  top,  in  the  political  and  ideological  area  is  where 
the  President  and  the  National  Security  Council  make  policy- 
type  decisions.   The  second  level,  the  conceptual  and  re- 
quirements area,  is  the  level  where  the  Secretary  of  Defense, 
the  Administrator  of  NASA,  and  the  individual  Service  Chiefs 
make  decisions.   The  third  level,  the  technology  area,  is 
where  the  individual  service  laboratories  and  the  laboratories 
of  industry  make  technical  decisions. 

The  basic  three-part  structure  is  then  sub-divided  into 
the  various  levels  shown  on  the  right  of  Figure  9  plus  the 
national  objective  level,  making  a  total  of  eight  levels. 
In  order  to  make  value  judgments  in  the  horizontal  plane  at 


72 


LU 

> 

LU 


CO 
LU 

> 

o 

LU 
— D 
DO 

O 

—I 
< 

o 

5 


H 

H 

o 

o 

~J 

_j 

LU 

LL. 

2 

2: 

o 

O 

o 

O 

LL 

LL. 

O 

O 

GO 

CO 

LU 
Cu 

2 

£ 

or 
0 

LU 

CO 
CO 


< 

or 

LU 
LU 

(3 


2  H 


LU  OQ  p 

o  <  bo 

en  n  lu 

O  <  oc 

lu  o  a. 


co    a    ^a_ 

O     LU      u 
O    DC     CO 


CO 

< 


OC 

o 

lu 


CO 


mo  <5 

<cc  dc< 

Q_  CU     LU> 


^  lu  00  r?  ^  o_n 
lu  lu  —  <  *>  4-  L-i 
LU     LU     DC     CJ~     0< 


K 

w 

Eh 
Eh 
< 
CU 

Cm 
O 

CD 
CD 

M 

Eh 

CD 
O 

C 

cd 
> 

CD 

1     ! 

CD 
K 


cd 

M 

CD 
C 

CD 
C3 


<D 

50 
•H 


73 


each  level  of  the  tree,  it  is  necessary  to  apply  rigid  defi- 
nitions to  each  item  on  the  tree  as  well  as  to  develop  a  set 
of  ground  rules  (criteria)  for  the  situation  at  hand.   Key 
words  representing  the  various  criteria  are  shown  on  the 
left  of  Figure  9-   In  developing  the  criteria,  it  is  impor- 
tant to  ensure  that  they  are  appropriate  to  the  level  at 
which  the  decision  is  to  be  made  and  that  they  are  mutually 
exclusive  in  so  far  as  possible. 

In  order  to  explain  the  terminology  associated  with 
relevance  trees,  the  top  four  levels  of  the  overall  struc- 
ture are  broken  down  into  finer  detail  in  Figure  10.   This 
figure  is  characteristic  of  the  "tree-like"  organization 
associated  with  decision  analysis .   At  the  top  is  the  United 
States'  National  Objectives.   The  next  level  Indicates  Lhe 
various  types  of  conflict  where  challenges  to  our  National 
Objectives  may  be  expected,  e.g.,  military  activities,  non- 
combat  activities  and  exploratory  and  civil  support  activi- 
ties.  The  next  level  indicates  the  form  that  these  challenges 
may  take,  i.e.,  various  types  of  limited  wars,  intelligence, 
arms  control,  etc.   Under  each  of  these  forms  of  conflict 
is  a  spectrum  of  missions  in  which  a  capability  must  be  de- 
veloped and  maintained  if  the  Government  is  to  counter  the 
challenge  in  each  specific  area  of  competition.   The  obvious 
advantage  of  this  type  of  detailed  structure  is  that  it  divides 
the.  large  many-faceted  problem  into  small  segments  and  permits 
one  to  make  comparisons  among  small  numbers  of  items  at  any 
single  level.   At  the  same  time,  the  capability  of  again 
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looking  at  the  total  package  as  an  entity  is  retained  once 
the  individual  value  judgments  have  been  made. 

Referring  to  Figure  10,  relevance  numbers  are  assigned 
at  each  node  of  the  tree  by  teams  of  experts  using  carefully 
selected  criteria  as  a  base  for  their  judgments.  The  basic 
procedure  is  to  employ  a  value  judgment  matrix  using  mathe- 
matical techniques  developed  for  decision-making  under  con- 
ditions of  uncertainty.  For  a  detailed  explanation  of  these 
mathematical  techniques  the  interested  reader  is  advised  to 
consult  Reference  25. 

The  lower  four  levels  of  the  overall  structure  (Figure 
9)   are  also  divided,  starting  with  postulated  concepts  as 
the  fifth  level.   At  the  sixth  level  each  of  the  concepts 
divided  into  seventeen  functional  subsystem  areas  together 
with  associated  requirements  needed  to  meet  concept  perfor- 
mance goals .   In  most  cases  there  are  several  alternative 
ways  by  which  the  functional  subsystem  requirements  can  be 
met.   These  alternate  methods  are  called  subsystem  config- 
urations and  constitute  the  seventh  level  of  the  structure. 
Contained  within  the  competing  subsystem  configurations  are 
the  technological  deficiences  to  be  solved.   These  deficiences 
represent  the  eighth  and  final  level. 

The  second  major  part  of  the  PATTERN  has  to  do  with  the 
status  and  timing  of  the  technology  needs .   Once  the  needs  of 
the  Government  are  assessed  an  evaluation  of  the  capability 
of  industry  to  achieve  the  technical  solutions  to  the  iden- 
tified problems  is  the  next  order  of  business.   To  initiate 
this  step  a  comprehensive  technical  forecast  using  several 
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exploratory  forecasting  techniques  is  conducted  and  an  as- 
sessment is  made  of  the  current  status  of  several  hundred 
technologies,  as  well  as  the  likely  rate  of  improvement  in 
performance  of  each  technology  area  over  time.   PATTERN 
then  uses  this  evaluation  of  the  status  of  technology  and 
its  projected  rate  of  growth  in  determining  the  time  and 
capability  required  to  meet  the  previously  identified  nation- 
al technical  needs.   These  data  are  then  inserted  at  the 
functional  subsystem  and  technical  deficiency  levels  in  the 
tree  and  indicate  the  capability  of  the  country  to  meet  its 
military/exploratory  type  technology  needs. 

The  third  major  part  of  PATTERN  consists  of  the  cross 
support  information.   Cross  support  as  defined  by  Honeywell, 
r6prcDciii/d  onC  'cocuj-  gain  j_ 1 1  t"ciin_Lcaj-  cs.ps.sjji.iivy 3    "cross 
all  subsystem  areas,  accumulated  by  working  in  a  specific 
subsystem  problem  area.   Time  is  used  as  the  common  denom- 
inator and  a  zero  to  one  scale  is  used  in  assigning  the 
cross  support  values.   Thus,  the  subsystem  configuration  cross 
support  number  represents  the  degree  to  which  solving  a 
specific  technical  problem  on  a  particular  subsystem  config- 
uration reduces  the  effort  needed  to  solve  similar  or  related 
subsystem  problems. 

The  flexibility  of  the  PATTERN  concept  is  demonstrated 
by  its  application  in  other  areas.  For  example,  Honeywell 
management  initiated  a  study  to  identify  present  and  future 
needs  in  bio-medicine  [25]  .   Honeywell  also  prepared  a  rele- 
vance tree  for  NASA's  Apollo  Program  [1] .   Approaches  very 
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similar  to  PATTERN  have  been  or  are  being  applied  to  strategic 
decision  making  in  a  number  of  industries  and  organizations, 
notably  by  Swager  [1]  and  Cetron  [3].   Fields  combines  the 
relevance  tree  concept  with  morphological  analysis  and  the 
Delphi  method  to  establish  a  general  procedure  for  techno- 
logical forecasting  [26]. 

The  author  is  of  the  opinion  that  the  real  values  of 
the  relevance  tree  scheme  is  in  combination  with  other  methods 
such  as  the  method  proposed  by  Fields  [26].   The  most  promi- 
nent example  of  the  application  of  the  relevance  tree  concept 
in  combination  with  other  forecasting  techniques  is  that  of 
the  Planning-Programming-Budgeting  System  (PPBS)  of  the 
U.  S.  Department  of  Defense.   The  PPB  System  is  built  around 
a  four-level  decision-tree  concept  which  in  closely  related 
to  the  relevance  trees  discussed  earlier.   Other  operations 
research/systems  analysis  techniques  and  the  Delphi  method 
are  used  in  conjunction  with  relevance  tree  techniques. 
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V.   CONCLUSION 

The  three  previous  sections  of  this  paper  have  been 
devoted  to  a  discussion  of  the  various  techniques  employed  in 
technological  forecasting.   It  must  be  remembered,  however, 
that  forecasting  in  general  is  beset  by  hazards,  simply  be- 
cause the  future  is  not  known.   Most  of  these  hazards,  e.g., 
the  uncertainty  and  unreliability  of  data,  apply  to  all  forms 
of  forecasting.   In  addition,  the  literature  suggests  there 
are  some  pitfalls  pertinent  to  technological  forecasting. 
It  seems  appropriate  at  this  time  to  point  out  some  of  these 
major  pitfalls,  since  improper  use  of  the  available  techni- 
ques may  lead  to  misdirected  goals  and  wasted  resources. 

A  bold  prediction  cf  large  increases  in  unknown  fane 
tional  capabilities  requires  considerable  imagination  on 
the  part  of  forecasters.   A  common  pitfall,  especially  among 
so-called  committees  of  experts,  is  a  lack  of  this  imagina- 
tion.  This  particular  problem  is  usually  in  the  form  of  the 
failure  to  see  converging  technical  developments,  the  ac- 
ceptance of  trends  as  rigidly  continuing,  the  reliance  on 
limited  information,  and  concentration  on  specific  configu- 
rations of  technology  now  in  use.   A  classic  example  cited 
by  Ayres  is  that  of  the  committee  selected  in  19^0  by  the 
National  Academy  of  Sciences  to  evaluate  the  proposed  gas 
turbine  [4].   The  committee's  reasoned  and  careful  conclu- 
sion, based  on  many  conservative  assumptions,  was  that  gas 
turbines  would  have  to  weigh   13  to  15  lb./hp  compared  with 
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1.1  lb./hp  for  internal-combustion  engines  then  operating. 
In  point  of  fact,  a  gas  turbine  was  in  operation  one  year 
later  with  a  weight  of  0.4  lb./hp. 

On  the  opposite  side  of  the  spectrum  there  are  indivi- 
duals of  scientific  bent  who  maintain  that  given  the  re- 
sources, time,  and  motivation,  the  human  intellect  can  create 
virtually  anything  it  can  conceive.   This  type  of  pitfall  can 
be  remedied  by  the  forecaster  if  he  does  not  attempt  to  pre- 
dict to  the  "nth"  limit  or  too  far  in  advance.   Again,  Ayres 
cites  some  interesting  examples  of  this  optimistic  attitude 
[4].   For  instance,  using  the  envelope  curve  for  vehicular 
speeds  it  appears  that  the  speed  of  light  would  seem  to  be 
achieved  by  1982.   Another  equally  ridiculous  example  of 
overcompensation  is  that  derived  from  life~expecLan*jy  trends. 
From  these  trends  forecasters  have  predicted  that  anyone 
born  after  2000  A.D.  will  live  forever,  barring  accidents  of 
course . 

Aspects  of  future  scientific  progress  can  also  be  poorly 
estimated  because  of  a  lack  of  consideration  of  seemingly  un- 
related factors,  such  as  resistance  to  change  by  vested  in- 
terests, public  inertia,  unforeseen  costs,  available  resources 
and  lack  of  understanding  of  new  technologies.   Many  research 
and  development  programs  of  a  few  years  ago  which  induced 
great  expectations  failed  to  have  a  truly  significant  effect 
on  the  present  environment.   Nuclear  powered  aircraft  and  the 
relatively  slow  advancement  of  nuclear  power  for  non-military 
use  are  typical  examples. 
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In  addition  to  the  foregoing  pitfalls,  it  must  be  recog- 
nized that  mistakes  in  methodology  are  also  cause  for  concern 
The  use  of  inappropriate  techniques  or  incorrect  calculations 
can  lead  the  forecaster  to  some  rather  interesting  conclu- 
sions.  Consider,  for  example,  the  calculation  made  by  the 
Canadian  astronomer,  J.  W.  Campbell,  that  a  moon  rocket  would 
have  to  weigh   one  million  tons  in  order  to  carry  one  pound 
of  payload  [4].   This  calculation  was  off  by  six  orders  of 
magnitude  due  to  unrealistic  assumptions  about  fuels  and 
failure  to  take  multiple  staging  into  account. 

Many  technological  advancements  depend  to  some  degree 
on  basically  unpredictable  elements  such  as  luck  or  coin- 
cidence, individual  insight,  personal  drives  and  various 
other  personality  traits.   In  faet3  the  creative  process  in 
humans,  which  is  probably  the  greatest  force  for  the  advance- 
ment of  technology,  is  not  yet  completely  understood  and 
should,  in  this  author's  opinion,  be  the  subject  of  more  in- 
tensive study. 

Given  that  various  techniques  and  their  associated  pit- 
falls exist,  the  natural  question  to  address  at  this  point 
is  what  should  be  considered  in  selecting  a  method.   The 
forecasting  techniques  discussed  in  the  three  previous  sec- 
tions ranged  from  intuitive  to  statistical  to  cause  and  ef- 
fect analysis  to  means  of  structuring  the  information  in 
order  to  examine  interrelationships  and  consider  alternatives 
The  techniques  presented  have  varying  degrees  of  complexity 
and  usefulness.   None  is  a  magic  formula  or  an  all-purpose 
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device  and  each  has  its  advocates  and  adversaries.   The 
point  to  keep  in  mind  is  that  all  can  be  useful.   The  tech- 
nique which  is  "best"  depends  upon  the  circumstances  under 
which  the  forecaster  is  working  and  his  needs;  the  reliability, 
completeness,  and  quantitative  precision  of  the  data  base; 
the  purpose  of  the  forecast;  the  length  of  the  forecast  period; 
and  the  time  available  for  generating  the  forecast.   In  gen- 
eral, the  level  of  treatment  should  correspond  to  the  impor- 
tance and  level  of  complexity  of  the  problem  area.   The 
technique  selected  should  be  compatible  with  and  adaptable  to 
the  available  information. 

Conversely,  there  appears  to  be  a  very  real  need  for 
improvement  in  the  level  or  degree  of  sophistication  with 
which  many  technologies  are  treated  by  forecasters,   For 
example,  the  most  unsophisticated  forecasting  technique  in 
use  today  is  the  individual  type.   It  has  been  estimated 
that  a  large  percentage  of  all  forecasting  done  by  the  mili- 
tary services  is  of  this  type  [3].   Frequently,  insufficient 
historical  data  preclude  the  use  of  more  sophisticated  tech- 
niques.  However,  in  this  author's  opinion,  there  are  many 
instances  where  substantial  quantities  of  reliable  data  are 
available  for  analysis  but  are  not  used.   As  a  result,  the 
level  of  confidence  which  can  be  ascribed  to  the  forecast 
is  frequently  less  than  desirable. 

The  literature  suggests  that  the  major  requisites  of 
good  forecasting  can  be  reduced  to:  (1)  the  knowledge  of 
scientific  and  technical  specialists  in  the  subject  matter 
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area;  (2)  astute  judgment  and  common  sense  on  the  part  of 
the  forecaster;  and  (3)  a  technical  understanding  of  avail- 
able forecasting  methods  and  how  and  when  to  apply  them. 
The  primary  gain  from  the  use  of  such  techniques  is  a 
greatly  improved  insight  into  the  nature  and  interrelation- 
ships of  influencing  factors  and  the  sensitivity  of  solutions 
to  these  factor  variations .   These  techniques  also  provide 
the  possibility  of  evaluating,  within  a  consistent  frame  of 
reference,  distinct  alternative  technical  solutions  to  a 
given  operational  problem.   In  effect,  the  techniques  pro- 
vide the  tools  whereby  the  technical  knowledge  and  judgment 
of  the  forecaster  can  be  applied  to  logical,  systematic 
thinking  about  the  pattern  of  development  of  the  particular 

i~  cu  ,"  p  p  c\    \  r\  n,\i 

The  best  forecast  for  a  given  purpose  may  require  the 
use  of  various  methods,  i.e.,  a  combination  of  Intuitive, 
exploratory,  and  normative  techniques.   The  several  fore- 
casts provide  a  range  of  probable  developments,  they  may  be 
combined  to  give  a  single  estimate  of  the  future,  or  they 
may  provide  a  choice  of  predictions  according  to  the  purpose 
for  which  it  is  intended.   A  recent  example  of  this  approach 
to  forecasting  is  offered  by  Fields  [26] .   Fields  made  a 
preliminary  study  of  the  techniques  currently  being  used 
and  recommended  that  a  combination  of  the  Delphi  technique, 
morphological  analysis,  and  the  relevance  tree  technique 
be  used.   In  addition,  many  experts  in  the  technological  fore- 
casting business  agree  with  Fields  and  suggest  that  for  most 
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applications  some  combination  of  the  available  techniques  is 
best . 

In  spite  of  the  wide  choice  of  techniques  and  knowledge 
of  the  pros  and  cons  of  these  techniques,  the  author  of  this 
paper  is  of  the  opinion  that  the  practice  of  technological 
forecasting  is  as  yet,  not  well  developed.   Furthermore, 
among  those  practioners  that  do  develop  formal  forecasts, 
there  is  little  evidence  of  effective  integration  with  plan- 
ning. 

Examples  of  useful  technological  forecasts  are  scarce 
because  of  widespread  resistance  or  neutrality  towards  the 
subject.   This  is  due  in  part  to  the  disadvantages,  limita- 
tions and  pitfalls  of  the  various  techniques  as  discussed 
in  the  preceding  paragraphs .   However,  the  primary  reason 
why  technological  forecasting  only  goes  as  far  as  "lip- 
service"  is  because  of  a  general  lack  of  understanding  of 
the  nature  of  change. 

The  greatest  benefit  of  forecasting  lies  in  its  use 
as  guidance  for  the  activities  of  organizations.   In  parti- 
cular, the  forecast  should  help  the  planner  make  correct 
decisions.   It  is  imperative  then  that  key  individuals  in  an 
organization  identify  all  areas  of  change  important  to  their 
organization  and  even  more  important  that  they  interpret  the 
potential  impact  that  an  observed  change  may  present.   The 
nature  of  change,  however,  presents  problems  which  organiza- 
tions have  been  unable  to  overcome  with  formal  forecasting 
techniques.   The  problematic  task  of  forecasting  all  possible 
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changes  that  may  occur  in  the  technical,  political,  and 
social  environments  surrounding  an  organization  appears  to 
be  more  difficult  than  the  literature  suggests.   The  mere 
accusation  that  management  suffers  from  a  "lack  of  imagina- 
tion" does  little  to  solve  the  problem. 

If  an  organization  is  to  prepare  for  the  future,  it  is 
not  merely  a  question  of  adopting  one  or  more  of  the  various 
techniques  and  applying  it  according  to  generally  accepted 
principles.   It  is  much  more  a  question  of  recognizing  and 
understanding  the  nature  of  changes  in  technology  and  its 
associated  effects  on  all  the  environments  surrounding  the 
organization.   Since  forecasting  efforts  are  directly  re- 
lated to  the  decision-making  process,  failure  to  allow  the 
results  of  forecasts  bo  affect  the  plans  of  the  organi  nation 
may  undersell  a  potentially  powerful  tool.   Until  these  dif- 
ficulties are  resolved,  they  will  continue  to  severely  limit 
the  applicability  of  the  formal  forecasting  techniques. 

The  past  decade  has  brought  a  new  attitude  toward  the 
future  in  public  and  private  planning  agencies.   This  change 
has  extended  customary  planning  horizons  to  a  more  distant 
future  and  replaced  haphazard  "fortune-telling"  techniques 
with  objective  analysis.   There  is  a  growing  awareness  that 
a  great  deal  can  be  said  about  future  trends  in  terms  of 
probability,  and  moreover,  that  through  proper  planning, 
these  probabilities  can  be  influenced  considerably.   The 
author  of  this  paper  suggests  that  further  research  should 
be  devoted  to  understanding;  the  structure  of  the  stochastic 
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process  involved  in  technological  forecasting.   In  particular, 
such  probabilities  as  the  conditional  probability  of  a  suc- 
cessful technical  solution  given  the  required  resources  and 
the  probability  that  these  required  resources  will  be  made 
available,  should  be  considered. 

If  the  author  of  this  paper  may  be  permitted  a  prophecy 
about  technological  forecasting,  the  next  decade  will  see  a 
host  of  conferences  with  great  stress  on  resolving  the  nature 
of  change  and  its  resulting  impacts.   This  author  forsees 
increasing  use  of  formal  technological  forecasting  techniques 
and  predicts  that  forecasts  will  look  further  and  further 
into  the  future.   This  longer  look,  coupled  with  the  acknow- 
ledgement of  the  non-technical  environment,  will  force  a 
thorough  integration  of  technological  forecasting  with  the 
decision-making  process. 
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APPENDIX  A  -  ANNOTATED  BILBIOGRAPHY 

"Technological  Forecasting  in  Perspective,"  an  inter- 
national survey  of  technological  forecasting  conducted  by 
Dr.  Erich  Jantsch,  is  based  on  eight  months  of  research  in 
thirteen  countries   [1] .   The  volume  contains  an  annotated 
bibliography  with  over  400  literature  references .   The  text 
begins  with  a  set  of  definitions  and  basic  concepts.   Part 
2,  A  Framework  for  Technological  Forecasting,  is  highly  con- 
ceptual and  philosophical.   While  Part  II,  Techniques  Rela- 
ted to  Technological  Forecasting  is  mathematically  oriented. 
Part  III,  Organization  of  Technological  Forecasting,  presents 
the  findings  of  Dr.  Jantsch's  search  for  applications.   Al- 
though the  author  of  this  paper  found  sections  of  the  book 
difficult  to  read,  it  is  recommedned  for  any  reader  inter- 
ested in  technological  forecasting. 

"Technological  Forecasting  for  Industry  and  Government," 
edited  by  James  R.  Bright,  contains  the  proceedings  of  the 
First  Annual  Technology  and  Management  Conference  [2].   The 
volume  covers  a  broad  range  of  topics  discussed  by  several 
well-known  experts  in  the  field  of  management .   This  author 
found  this  book  relatively  easy  to  read  and  it  too  included 
an  annotated  bibliography. 

"Technological  Forecasting:   A  Practical  Approach"  is 
written  by  Marvin  J.  Cetron  and  is  based  on  his  experience 
with  the  Department  of  Defense  [3]-   As  a  result,  many  of 
the  concepts  and  ideas  are  illustrated  with  military  ex- 
amples . 

87 


Cetron  draws  several  analogies  between  military  programs  and 
business  situations  thus  giving  the  reader  a  broader  view 
of  the  domain  of  technological  forecasting.   The  author's 
organized,  list-making  style  is  very  readable;  and  his  an- 
notated bibliographies  are  extensive. 

"Technological  Forecasting  and  Long  Range  Planning," 
by  Robert  U.  Ayres,  provides  an  excellent  description  of  the 
methods  employed  in  exploratory  forecasting  [4].   While  the 
mathematical  sophistication  may  be  difficult  for  some  readers, 
they  are  not  crucial  to  understanding  the  methods,  and  should 
not  prevent  the  reader  from  appreciating  the  use  of  a  large 
number  of  industrial  examples. 
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